Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 944042 Details for
Bug 1149496
Starting vms simultaneously broke affinity rules
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine log
engine.log (text/plain), 730.82 KB, created by
Artyom
on 2014-10-05 13:32:20 UTC
(
hide
)
Description:
engine log
Filename:
MIME Type:
Creator:
Artyom
Created:
2014-10-05 13:32:20 UTC
Size:
730.82 KB
patch
obsolete
>2014-10-05 13:19:36,483 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-05 13:19:36,484 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-05 13:19:36,484 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-05 13:19:36,484 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-05 13:19:36,484 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-05 13:19:36,484 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-05 13:19:36,485 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-05 13:19:36,485 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-05 13:19:36,485 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-05 13:19:36,485 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-05 13:19:36,486 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-05 13:19:36,486 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-05 13:19:36,486 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-05 13:19:36,486 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-05 13:19:36,486 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-05 13:19:36,487 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-05 13:19:36,487 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_USER" is "engine". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_FQDN" is "hosted_test.qa.lab.tlv.redhat.com". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-05 13:19:36,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-10-05 13:19:36,491 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_USER" is "ovirt". >2014-10-05 13:19:36,492 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-05 13:19:36,499 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-05 13:19:36,500 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-05 13:19:36,500 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-05 13:19:36,501 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-05 13:19:36,501 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-05 13:19:37,724 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) Start initializing Backend >2014-10-05 13:19:37,995 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 47) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-05 13:19:38,074 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) Running ovirt-engine 3.4.3-1.1.el6ev >2014-10-05 13:19:38,075 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 47) Start initializing dictionaries >2014-10-05 13:19:38,077 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 47) Finished initializing dictionaries >2014-10-05 13:19:38,078 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) Start initializing AuditLogCleanupManager >2014-10-05 13:19:38,078 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-05 13:19:38,087 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) Finished initializing AuditLogCleanupManager >2014-10-05 13:19:38,090 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) Start initializing TagsDirector >2014-10-05 13:19:38,096 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) Tag root added to tree >2014-10-05 13:19:38,110 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) Finished initializing TagsDirector >2014-10-05 13:19:38,112 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 47) Start initializing IsoDomainListSyncronizer >2014-10-05 13:19:38,115 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 47) Finished initializing IsoDomainListSyncronizer >2014-10-05 13:19:38,158 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) Completed initializing handlers >2014-10-05 13:19:38,158 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) Start initializing ErrorTranslatorImpl >2014-10-05 13:19:38,165 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-05 13:19:38,166 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) Finished initializing ErrorTranslatorImpl >2014-10-05 13:19:38,166 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) Start initializing ErrorTranslatorImpl >2014-10-05 13:19:38,166 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) Finished initializing ErrorTranslatorImpl >2014-10-05 13:19:38,166 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) Mark incomplete jobs as UNKNOWN >2014-10-05 13:19:38,213 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 47) Start initializing JobRepositoryCleanupManager >2014-10-05 13:19:38,213 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 47) Finished initializing JobRepositoryCleanupManager >2014-10-05 13:19:38,214 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 47) Start initializing AutoRecoveryManager >2014-10-05 13:19:38,215 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 47) Finished initializing AutoRecoveryManager >2014-10-05 13:19:38,216 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 47) Start initializing ExecutionMessageDirector >2014-10-05 13:19:38,217 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 47) Finished initializing ExecutionMessageDirector >2014-10-05 13:19:38,268 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 38) Start initializing UsersDomainsCacheManagerService >2014-10-05 13:19:38,273 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 38) Start initializing DbUserCacheManager >2014-10-05 13:19:38,274 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 38) Finished initializing DbUserCacheManager >2014-10-05 13:19:38,274 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 38) Finished initializing UsersDomainsCacheManagerService >2014-10-05 13:19:38,335 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 42) Initialization of AsyncTaskManager completed successfully. >2014-10-05 13:19:38,336 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 42) Start initializing ResourceManager >2014-10-05 13:19:38,473 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 42) Finished initializing ResourceManager >2014-10-05 13:19:38,477 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 42) Initialization of OvfDataUpdater completed successfully. >2014-10-05 13:19:38,479 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Start scheduling to enable vds load balancer >2014-10-05 13:19:38,480 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Finished scheduling to enable vds load balancer >2014-10-05 13:19:38,480 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Start HA Reservation check >2014-10-05 13:19:38,480 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Finished HA Reservation check >2014-10-05 13:19:38,494 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(650489ad): Start initializing >2014-10-05 13:19:38,501 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 42) Init VM custom properties utilities >2014-10-05 13:19:38,533 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(650489ad): Finished initializing. Available MACs in pool: 256 >2014-10-05 13:19:38,538 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 42) Init device custom properties utilities >2014-10-05 13:19:38,545 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Initializing Scheduling manager >2014-10-05 13:19:38,597 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) External scheduler disabled, discovery skipped >2014-10-05 13:19:38,597 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 42) Initialized Scheduling manager >2014-10-05 13:19:38,597 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 42) Initializing DWH Heart Beat >2014-10-05 13:19:38,598 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 42) DWH Heart Beat initialized >2014-10-05 13:19:40,760 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-10-05 13:19:40,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: UNASSIGNED not exist in string table >2014-10-05 13:19:40,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-10-05 13:19:40,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-10-05 13:19:40,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-10-05 13:19:40,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: DWH_STOPPED not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: DWH_STARTED not exist in string table >2014-10-05 13:19:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: DWH_ERROR not exist in string table >2014-10-05 13:19:40,800 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-10-05 13:19:40,800 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-10-05 13:19:40,800 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-10-05 13:19:40,801 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-10-05 13:19:40,802 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-10-05 13:19:40,802 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,805 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,806 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:19:40,958 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-05 13:19:42,570 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-6) [49caba14] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:19:42,674 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:19:42,697 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000366 value: REGISTER_VDS >, sharedLocks= ] >2014-10-05 13:19:42,710 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] START, RemoveVdsVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 616e0a94 >2014-10-05 13:19:42,710 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] FINISH, RemoveVdsVDSCommand, log id: 616e0a94 >2014-10-05 13:19:42,714 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] START, AddVdsVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 6dbc2f23 >2014-10-05 13:19:42,714 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] AddVds - entered , starting logic to add VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 >2014-10-05 13:19:42,717 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] AddVds - VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added, will try to add it to the resource manager >2014-10-05 13:19:42,720 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [2790c52d] Entered VdsManager constructor >2014-10-05 13:19:42,736 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [2790c52d] Initialize vdsBroker (10.35.97.36,54,321) >2014-10-05 13:19:42,798 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [2790c52d] VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added to the Resource Manager >2014-10-05 13:19:42,799 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [2790c52d] FINISH, AddVdsVDSCommand, log id: 6dbc2f23 >2014-10-05 13:19:42,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [2790c52d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. >2014-10-05 13:19:42,845 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [2790c52d] Correlation ID: 49caba14, Job ID: 7ab3d99d-d72f-4e82-b835-c74212ba383c, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was added by admin. >2014-10-05 13:19:42,868 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Lock Acquired to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 13:19:42,885 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Running command: InstallVdsCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:19:42,901 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Before Installation host 25466fb3-6dfd-4f53-82ce-c622f4ab7726, hosted_engine_1 >2014-10-05 13:19:42,927 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1e4afd64 >2014-10-05 13:19:42,966 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] FINISH, SetVdsStatusVDSCommand, log id: 1e4afd64 >2014-10-05 13:19:43,042 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-3) [eecb914] Installation 10.35.97.36: Connected to host 10.35.97.36 with SSH key fingerprint: a9:d9:aa:82:f9:9c:0b:88:f9:a6:94:6f:83:53:30:82 >2014-10-05 13:19:43,055 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [eecb914] Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Connected to host 10.35.97.36 with SSH key fingerprint: a9:d9:aa:82:f9:9c:0b:88:f9:a6:94:6f:83:53:30:82. >2014-10-05 13:19:43,085 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-3) [eecb914] Installation of 10.35.97.36. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-05 13:19:43,085 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-4-thread-3) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' is missing, creating >2014-10-05 13:19:43,246 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-3) SSH execute root@10.35.97.36 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-05 13:19:43,880 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Initializing >2014-10-05 13:19:43,890 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Initializing. >2014-10-05 13:19:43,907 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Environment setup >2014-10-05 13:19:43,913 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment setup. >2014-10-05 13:19:43,921 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Environment packages setup >2014-10-05 13:19:43,926 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment packages setup. >2014-10-05 13:19:45,800 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-12) Initializing Host: hosted_engine_1 >2014-10-05 13:19:45,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Programs detection >2014-10-05 13:19:45,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Programs detection. >2014-10-05 13:19:45,870 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Environment customization >2014-10-05 13:19:45,877 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment customization. >2014-10-05 13:19:45,899 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Logs at host located at: '/tmp/ovirt-host-deploy-20141005131944-iwwig0.log' >2014-10-05 13:19:45,954 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Logs at host located at: '/tmp/ovirt-host-deploy-20141005131944-iwwig0.log'. >2014-10-05 13:19:46,026 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.35.97.36 reports unique id 4C4C4544-0057-5610-8056-C4C04F4D5731 >2014-10-05 13:19:46,035 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0057-5610-8056-C4C04F4D5731 to Host 10.35.97.36 >2014-10-05 13:19:46,093 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Setup validation >2014-10-05 13:19:46,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Setup validation. >2014-10-05 13:19:46,129 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Hardware supports virtualization >2014-10-05 13:19:46,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Hardware supports virtualization. >2014-10-05 13:19:46,239 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Transaction setup >2014-10-05 13:19:46,245 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Transaction setup. >2014-10-05 13:19:46,296 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Misc configuration >2014-10-05 13:19:46,306 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Misc configuration. >2014-10-05 13:19:46,306 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Package installation >2014-10-05 13:19:46,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Package installation. >2014-10-05 13:19:57,418 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Misc configuration >2014-10-05 13:19:57,425 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Misc configuration. >2014-10-05 13:19:57,505 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Setting time >2014-10-05 13:19:57,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Setting time. >2014-10-05 13:19:58,916 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Enrolling certificate >2014-10-05 13:19:58,921 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Enrolling certificate. >2014-10-05 13:20:00,215 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Transaction commit >2014-10-05 13:20:00,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Transaction commit. >2014-10-05 13:20:00,243 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Closing up >2014-10-05 13:20:00,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Closing up. >2014-10-05 13:20:01,186 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stopping libvirtd >2014-10-05 13:20:01,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stopping libvirtd. >2014-10-05 13:20:01,432 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Starting vdsm >2014-10-05 13:20:01,443 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Starting vdsm. >2014-10-05 13:20:03,215 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Pre-termination >2014-10-05 13:20:03,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Pre-termination. >2014-10-05 13:20:03,239 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005132003-10.35.97.36-eecb914.log' >2014-10-05 13:20:03,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005132003-10.35.97.36-eecb914.log'. >2014-10-05 13:20:03,458 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.97.36: Stage: Termination >2014-10-05 13:20:03,463 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: eecb914, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Termination. >2014-10-05 13:20:03,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:20:03,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Command PollVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:20:04,329 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:20:04,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Command PollVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:20:04,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:20:04,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Command PollVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:20:05,361 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-3) [eecb914] Engine managed to communicate with VDSM agent on host hosted_engine_1 >2014-10-05 13:20:05,579 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 293ea276 >2014-10-05 13:20:05,585 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] FINISH, SetVdsStatusVDSCommand, log id: 293ea276 >2014-10-05 13:20:05,585 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] After Installation host hosted_engine_1, VDS >2014-10-05 13:20:05,594 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [eecb914] Correlation ID: eecb914, Job ID: 7ab3d99d-d72f-4e82-b835-c74212ba383c, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 installed >2014-10-05 13:20:05,606 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-3) [eecb914] Lock freed to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 13:20:06,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 1b5e0ed1 >2014-10-05 13:20:06,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetHardwareInfoVDSCommand, log id: 1b5e0ed1 >2014-10-05 13:20:07,052 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-53) [2f5450db] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:20:07,133 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (DefaultQuartzScheduler_Worker-53) [14097aac] Running command: UpdateVdsGroupCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:20:07,159 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [14097aac] Correlation ID: 14097aac, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by system >2014-10-05 13:20:07,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [14097aac] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 619876a2 >2014-10-05 13:20:07,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [14097aac] FINISH, GetHardwareInfoVDSCommand, log id: 619876a2 >2014-10-05 13:20:07,300 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [14097aac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 13:20:07,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) [14097aac] START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 1d97ab7b >2014-10-05 13:20:07,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) [14097aac] FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, vmType=kvm, status=Up, emulatedMachine=rhel6.5.0, guestIPs=, displayIp=0, pauseCode=NOERR, display=vnc, pid=13981, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestFQDN=, username=Unknown, vmId=78012759-feaf-418a-88bb-55527c8140c8, clientIp=, devices=[Ljava.lang.Object;@7ca151e8, vmName=HostedEngine, cpuType=Conroe}], log id: 1d97ab7b >2014-10-05 13:20:07,405 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) [14097aac] Importing VM HostedEngine as HostedEngine, as it is running on the on Host, but does not exist in the engine. >2014-10-05 13:20:07,449 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) [14097aac] VDS::UpdateVmRunTimeInfo Error: found VM on a VDS that is not in the database! >2014-10-05 13:20:07,459 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-53) [420cc049] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 13:20:07,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [420cc049] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 4e4af2a3 >2014-10-05 13:20:07,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [420cc049] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4e4af2a3 >2014-10-05 13:20:07,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [420cc049] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. >2014-10-05 13:20:07,717 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-53) [506da876] Lock Acquired to object EngineLock [exclusiveLocks= key: HostedEngine value: VM_NAME >, sharedLocks= ] >2014-10-05 13:20:07,806 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-53) [506da876] Running command: AddVmFromScratchCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:20:07,900 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp-/127.0.0.1:8702-6) [41165719] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:20:08,229 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [41165719] Correlation ID: 41165719, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by admin >2014-10-05 13:20:08,488 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [506da876] Correlation ID: 506da876, Job ID: e1197069-8ea0-4409-b108-e02400fd31b1, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine was created by Non interactive user. >2014-10-05 13:20:08,547 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-53) [506da876] Lock freed to object EngineLock [exclusiveLocks= key: HostedEngine value: VM_NAME >, sharedLocks= ] >2014-10-05 13:20:08,549 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-53) [309ff665] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:20:08,555 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-53) [6dc3d36] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:20:11,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-65) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 526e9ec9 >2014-10-05 13:20:11,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-65) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, vmType=kvm, status=Up, emulatedMachine=rhel6.5.0, guestIPs=, displayIp=0, pauseCode=NOERR, display=vnc, pid=13981, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestFQDN=, username=Unknown, vmId=78012759-feaf-418a-88bb-55527c8140c8, clientIp=, devices=[Ljava.lang.Object;@526be4ef, vmName=HostedEngine, cpuType=Conroe}], log id: 526e9ec9 >2014-10-05 13:20:11,698 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Received a console Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=console0, specParams={}, device=console, type=console, deviceId=c95bddaf-9b44-4e16-9de8-799acd0ee966} >2014-10-05 13:20:11,698 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Received a memballoon Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-10-05 13:20:11,699 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Empty or NULL values were passed for a VM 78012759-feaf-418a-88bb-55527c8140c8 device, Device is skipped >2014-10-05 13:22:38,437 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-05 13:22:38,442 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-05 13:22:38,443 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-05 13:22:38,443 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-05 13:22:38,443 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-05 13:22:38,443 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-05 13:22:38,443 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-05 13:22:38,445 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-05 13:22:38,446 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-05 13:22:38,446 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-05 13:22:38,446 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-05 13:22:38,450 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-05 13:22:38,450 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-05 13:22:38,450 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-05 13:22:38,450 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-05 13:22:38,450 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-05 13:22:38,451 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-05 13:22:38,451 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-05 13:22:38,454 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DB_USER" is "engine". >2014-10-05 13:22:38,454 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-05 13:22:38,454 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-05 13:22:38,454 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_FQDN" is "hosted_test.qa.lab.tlv.redhat.com". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-05 13:22:38,455 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_USER" is "ovirt". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-05 13:22:38,456 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-05 13:22:38,457 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-05 13:22:38,457 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-05 13:22:38,457 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 42) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-05 13:22:39,643 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 36) Start initializing Backend >2014-10-05 13:22:39,935 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 36) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-05 13:22:40,050 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 36) Running ovirt-engine 3.4.3-1.1.el6ev >2014-10-05 13:22:40,051 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 36) Start initializing dictionaries >2014-10-05 13:22:40,053 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 36) Finished initializing dictionaries >2014-10-05 13:22:40,053 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 36) Start initializing AuditLogCleanupManager >2014-10-05 13:22:40,053 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 36) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-05 13:22:40,072 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 36) Finished initializing AuditLogCleanupManager >2014-10-05 13:22:40,074 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 36) Start initializing TagsDirector >2014-10-05 13:22:40,083 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 36) Tag root added to tree >2014-10-05 13:22:40,100 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 36) Finished initializing TagsDirector >2014-10-05 13:22:40,102 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 36) Start initializing IsoDomainListSyncronizer >2014-10-05 13:22:40,106 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 36) Finished initializing IsoDomainListSyncronizer >2014-10-05 13:22:40,169 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 36) Completed initializing handlers >2014-10-05 13:22:40,170 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 36) Start initializing ErrorTranslatorImpl >2014-10-05 13:22:40,182 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 36) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-05 13:22:40,182 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 36) Finished initializing ErrorTranslatorImpl >2014-10-05 13:22:40,183 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 36) Start initializing ErrorTranslatorImpl >2014-10-05 13:22:40,183 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 36) Finished initializing ErrorTranslatorImpl >2014-10-05 13:22:40,183 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 36) Mark incomplete jobs as UNKNOWN >2014-10-05 13:22:40,215 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 36) Start initializing JobRepositoryCleanupManager >2014-10-05 13:22:40,215 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 36) Finished initializing JobRepositoryCleanupManager >2014-10-05 13:22:40,219 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 36) Start initializing AutoRecoveryManager >2014-10-05 13:22:40,220 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 36) Finished initializing AutoRecoveryManager >2014-10-05 13:22:40,221 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 36) Start initializing ExecutionMessageDirector >2014-10-05 13:22:40,221 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 36) Finished initializing ExecutionMessageDirector >2014-10-05 13:22:40,315 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 45) Start initializing UsersDomainsCacheManagerService >2014-10-05 13:22:40,319 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 45) Start initializing DbUserCacheManager >2014-10-05 13:22:40,324 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 45) Finished initializing DbUserCacheManager >2014-10-05 13:22:40,324 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 45) Finished initializing UsersDomainsCacheManagerService >2014-10-05 13:22:40,353 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 44) Initialization of AsyncTaskManager completed successfully. >2014-10-05 13:22:40,358 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 44) Start initializing ResourceManager >2014-10-05 13:22:40,487 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 44) Entered VdsManager constructor >2014-10-05 13:22:40,519 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 44) Initialize vdsBroker (10.35.97.36,54,321) >2014-10-05 13:22:40,686 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 44) VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added to the Resource Manager >2014-10-05 13:22:40,707 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 44) Finished initializing ResourceManager >2014-10-05 13:22:40,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 44) Initialization of OvfDataUpdater completed successfully. >2014-10-05 13:22:40,713 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Start scheduling to enable vds load balancer >2014-10-05 13:22:40,714 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Finished scheduling to enable vds load balancer >2014-10-05 13:22:40,714 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Start HA Reservation check >2014-10-05 13:22:40,714 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Finished HA Reservation check >2014-10-05 13:22:40,730 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(621f48cc): Start initializing >2014-10-05 13:22:40,731 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 44) Init VM custom properties utilities >2014-10-05 13:22:40,732 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 44) Init device custom properties utilities >2014-10-05 13:22:40,734 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Initializing Scheduling manager >2014-10-05 13:22:40,767 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(621f48cc): Finished initializing. Available MACs in pool: 256 >2014-10-05 13:22:40,787 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) External scheduler disabled, discovery skipped >2014-10-05 13:22:40,787 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 44) Initialized Scheduling manager >2014-10-05 13:22:40,788 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 44) Initializing DWH Heart Beat >2014-10-05 13:22:40,789 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 44) DWH Heart Beat initialized >2014-10-05 13:22:44,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 7019f339 >2014-10-05 13:22:44,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 7019f339 >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: UNASSIGNED not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-05 13:22:44,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-05 13:22:44,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-05 13:22:44,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STOPPED not exist in string table >2014-10-05 13:22:44,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STARTED not exist in string table >2014-10-05 13:22:44,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_ERROR not exist in string table >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-10-05 13:22:44,258 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,259 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:22:44,296 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 13:22:44,325 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM HostedEngine 78012759-feaf-418a-88bb-55527c8140c8 moved from Up --> PoweringUp >2014-10-05 13:22:44,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 1bc9848f >2014-10-05 13:22:44,412 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, displayIp=0, pauseCode=NOERR, display=vnc, pid=21924, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, clientIp=, vmId=78012759-feaf-418a-88bb-55527c8140c8, devices=[Ljava.lang.Object;@5290a26b, vmName=HostedEngine, cpuType=Conroe}], log id: 1bc9848f >2014-10-05 13:22:44,421 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Received a console Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=console0, specParams={}, device=console, type=console, deviceId=c95bddaf-9b44-4e16-9de8-799acd0ee966} >2014-10-05 13:22:44,421 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Received a memballoon Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-10-05 13:22:44,421 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Empty or NULL values were passed for a VM 78012759-feaf-418a-88bb-55527c8140c8 device, Device is skipped >2014-10-05 13:22:44,535 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 >2014-10-05 13:22:44,674 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [4ff353fd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:22:56,915 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) VM HostedEngine 78012759-feaf-418a-88bb-55527c8140c8 moved from PoweringUp --> Up >2014-10-05 13:26:06,843 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-10-05 13:26:07,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-05 13:26:08,795 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-1) [4d04f2f3] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:26:08,855 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:26:08,881 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000366 value: REGISTER_VDS >, sharedLocks= ] >2014-10-05 13:26:08,883 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] START, RemoveVdsVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 15c80000 >2014-10-05 13:26:08,883 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] FINISH, RemoveVdsVDSCommand, log id: 15c80000 >2014-10-05 13:26:08,884 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] START, AddVdsVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 5350c62a >2014-10-05 13:26:08,884 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] AddVds - entered , starting logic to add VDS a6249d4e-b23d-4a14-9f56-a0761d824721 >2014-10-05 13:26:08,885 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] AddVds - VDS a6249d4e-b23d-4a14-9f56-a0761d824721 was added, will try to add it to the resource manager >2014-10-05 13:26:08,885 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [3b4d106f] Entered VdsManager constructor >2014-10-05 13:26:08,890 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [3b4d106f] Initialize vdsBroker (10.35.64.85,54,321) >2014-10-05 13:26:08,894 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [3b4d106f] VDS a6249d4e-b23d-4a14-9f56-a0761d824721 was added to the Resource Manager >2014-10-05 13:26:08,895 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [3b4d106f] FINISH, AddVdsVDSCommand, log id: 5350c62a >2014-10-05 13:26:08,906 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [3b4d106f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_2. >2014-10-05 13:26:08,932 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Lock Acquired to object EngineLock [exclusiveLocks= key: a6249d4e-b23d-4a14-9f56-a0761d824721 value: VDS >, sharedLocks= ] >2014-10-05 13:26:08,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [3b4d106f] Correlation ID: 4d04f2f3, Job ID: 739f2ca6-cbf0-425e-8cef-aec6573a9c8e, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was added by admin. >2014-10-05 13:26:08,943 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Running command: InstallVdsCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:26:08,961 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Before Installation host a6249d4e-b23d-4a14-9f56-a0761d824721, hosted_engine_2 >2014-10-05 13:26:08,986 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 667243c2 >2014-10-05 13:26:08,999 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] FINISH, SetVdsStatusVDSCommand, log id: 667243c2 >2014-10-05 13:26:09,083 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Installation 10.35.64.85: Connected to host 10.35.64.85 with SSH key fingerprint: c1:0c:d6:d7:dc:03:6f:31:51:fe:10:76:c7:36:c5:02 >2014-10-05 13:26:09,093 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Connected to host 10.35.64.85 with SSH key fingerprint: c1:0c:d6:d7:dc:03:6f:31:51:fe:10:76:c7:36:c5:02. >2014-10-05 13:26:09,121 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Installation of 10.35.64.85. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-05 13:26:09,144 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-11) SSH execute root@10.35.64.85 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-05 13:26:10,070 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Initializing >2014-10-05 13:26:10,076 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Initializing. >2014-10-05 13:26:10,094 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Environment setup >2014-10-05 13:26:10,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment setup. >2014-10-05 13:26:10,112 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Environment packages setup >2014-10-05 13:26:10,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment packages setup. >2014-10-05 13:26:11,891 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Initializing Host: hosted_engine_2 >2014-10-05 13:26:12,564 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Programs detection >2014-10-05 13:26:12,569 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Programs detection. >2014-10-05 13:26:12,571 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Environment customization >2014-10-05 13:26:12,575 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment customization. >2014-10-05 13:26:12,616 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Logs at host located at: '/tmp/ovirt-host-deploy-20141005132757-6s1tkd.log' >2014-10-05 13:26:12,622 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Logs at host located at: '/tmp/ovirt-host-deploy-20141005132757-6s1tkd.log'. >2014-10-05 13:26:12,696 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.35.64.85 reports unique id 55157E90-C28C-11E0-983A-5CF3FC78F458 >2014-10-05 13:26:12,704 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 55157E90-C28C-11E0-983A-5CF3FC78F458 to Host 10.35.64.85 >2014-10-05 13:26:12,773 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Setup validation >2014-10-05 13:26:12,779 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Setup validation. >2014-10-05 13:26:12,933 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Hardware supports virtualization >2014-10-05 13:26:12,938 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Hardware supports virtualization. >2014-10-05 13:26:13,156 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Transaction setup >2014-10-05 13:26:13,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Transaction setup. >2014-10-05 13:26:13,209 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Misc configuration >2014-10-05 13:26:13,221 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Misc configuration. >2014-10-05 13:26:13,221 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Package installation >2014-10-05 13:26:13,227 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Package installation. >2014-10-05 13:26:16,931 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Misc configuration >2014-10-05 13:26:16,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Misc configuration. >2014-10-05 13:26:16,998 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Setting time >2014-10-05 13:26:17,005 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Setting time. >2014-10-05 13:26:19,947 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Enrolling certificate >2014-10-05 13:26:19,953 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Enrolling certificate. >2014-10-05 13:26:21,178 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Transaction commit >2014-10-05 13:26:21,183 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Transaction commit. >2014-10-05 13:26:21,231 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Closing up >2014-10-05 13:26:21,236 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Closing up. >2014-10-05 13:26:22,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stopping libvirtd >2014-10-05 13:26:22,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stopping libvirtd. >2014-10-05 13:26:23,142 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Starting vdsm >2014-10-05 13:26:23,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Starting vdsm. >2014-10-05 13:26:25,626 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Pre-termination >2014-10-05 13:26:25,631 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Pre-termination. >2014-10-05 13:26:25,651 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005132625-10.35.64.85-3b7df734.log' >2014-10-05 13:26:25,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005132625-10.35.64.85-3b7df734.log'. >2014-10-05 13:26:26,055 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.35.64.85: Stage: Termination >2014-10-05 13:26:26,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3b7df734, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Termination. >2014-10-05 13:26:26,176 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:26,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Command PollVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:26,689 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:26,690 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Command PollVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:27,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:27,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Command PollVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 13:26:27,777 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:26:27,778 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Command PollVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 13:26:28,290 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Engine managed to communicate with VDSM agent on host hosted_engine_2 >2014-10-05 13:26:28,512 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 6c131c9e >2014-10-05 13:26:28,525 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] FINISH, SetVdsStatusVDSCommand, log id: 6c131c9e >2014-10-05 13:26:28,525 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] After Installation host hosted_engine_2, VDS >2014-10-05 13:26:28,545 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Correlation ID: 3b7df734, Job ID: 739f2ca6-cbf0-425e-8cef-aec6573a9c8e, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 installed >2014-10-05 13:26:28,554 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-11) [3b7df734] Lock freed to object EngineLock [exclusiveLocks= key: a6249d4e-b23d-4a14-9f56-a0761d824721 value: VDS >, sharedLocks= ] >2014-10-05 13:26:29,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721]), log id: 13c4b274 >2014-10-05 13:26:30,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GetHardwareInfoVDSCommand, log id: 13c4b274 >2014-10-05 13:26:30,109 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-70) [353081df] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:26:30,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) [353081df] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721]), log id: 3cfeedb4 >2014-10-05 13:26:30,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) [353081df] FINISH, GetHardwareInfoVDSCommand, log id: 3cfeedb4 >2014-10-05 13:26:30,231 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) [353081df] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_2. >2014-10-05 13:26:30,291 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-70) [5145f79d] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 13:26:30,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-70) [5145f79d] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 55a991d1 >2014-10-05 13:26:30,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-70) [5145f79d] FINISH, SetMOMPolicyParametersVDSCommand, log id: 55a991d1 >2014-10-05 13:26:30,404 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) [5145f79d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_2. >2014-10-05 13:26:30,419 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-70) [2bff0440] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:26:30,422 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-70) [2d92002e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:26:31,349 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp-/127.0.0.1:8702-8) [6b9b0f25] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 13:26:31,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [6b9b0f25] Correlation ID: 6b9b0f25, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by admin >2014-10-05 13:29:47,727 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = WaitForLaunch on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:29:50,765 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-47) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = WaitForLaunch on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:29:53,796 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-57) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = WaitForLaunch on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:29:56,834 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = WaitForLaunch on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:29:59,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=78012759-feaf-418a-88bb-55527c8140c8, force=false, secondsToWait=0, gracefully=false), log id: 3ae7bf22 >2014-10-05 13:30:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, DestroyVDSCommand, log id: 3ae7bf22 >2014-10-05 13:30:00,173 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down. Exit message: internal error Failed to acquire lock: error -243. >2014-10-05 13:30:00,175 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = Down on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:52:23,845 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-05 13:52:23,852 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-05 13:52:23,852 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-05 13:52:23,853 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-05 13:52:23,853 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-05 13:52:23,853 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-05 13:52:23,853 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-05 13:52:23,853 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-05 13:52:23,854 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_USER" is "engine". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-05 13:52:23,855 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_FQDN" is "hosted_test.qa.lab.tlv.redhat.com". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-05 13:52:23,856 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-05 13:52:23,857 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USER" is "ovirt". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-05 13:52:23,858 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-05 13:52:26,146 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 44) Start initializing Backend >2014-10-05 13:52:26,861 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 44) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-05 13:52:27,059 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 44) Running ovirt-engine 3.4.3-1.1.el6ev >2014-10-05 13:52:27,065 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 44) Start initializing dictionaries >2014-10-05 13:52:27,069 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 44) Finished initializing dictionaries >2014-10-05 13:52:27,069 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 44) Start initializing AuditLogCleanupManager >2014-10-05 13:52:27,070 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 44) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-05 13:52:27,176 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 44) Finished initializing AuditLogCleanupManager >2014-10-05 13:52:27,190 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 44) Start initializing TagsDirector >2014-10-05 13:52:27,217 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 44) Tag root added to tree >2014-10-05 13:52:27,235 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 44) Finished initializing TagsDirector >2014-10-05 13:52:27,238 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 44) Start initializing IsoDomainListSyncronizer >2014-10-05 13:52:27,244 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 44) Finished initializing IsoDomainListSyncronizer >2014-10-05 13:52:27,348 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 44) Completed initializing handlers >2014-10-05 13:52:27,349 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 44) Start initializing ErrorTranslatorImpl >2014-10-05 13:52:27,461 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 44) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-05 13:52:27,462 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 44) Finished initializing ErrorTranslatorImpl >2014-10-05 13:52:27,463 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 44) Start initializing ErrorTranslatorImpl >2014-10-05 13:52:27,463 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 44) Finished initializing ErrorTranslatorImpl >2014-10-05 13:52:27,463 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 44) Mark incomplete jobs as UNKNOWN >2014-10-05 13:52:27,546 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 44) Start initializing JobRepositoryCleanupManager >2014-10-05 13:52:27,547 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 44) Finished initializing JobRepositoryCleanupManager >2014-10-05 13:52:27,548 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 44) Start initializing AutoRecoveryManager >2014-10-05 13:52:27,549 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 44) Finished initializing AutoRecoveryManager >2014-10-05 13:52:27,551 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 44) Start initializing ExecutionMessageDirector >2014-10-05 13:52:27,552 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 44) Finished initializing ExecutionMessageDirector >2014-10-05 13:52:27,704 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 40) Start initializing UsersDomainsCacheManagerService >2014-10-05 13:52:27,717 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 40) Start initializing DbUserCacheManager >2014-10-05 13:52:27,723 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 40) Finished initializing DbUserCacheManager >2014-10-05 13:52:27,724 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 40) Finished initializing UsersDomainsCacheManagerService >2014-10-05 13:52:27,759 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 38) Initialization of AsyncTaskManager completed successfully. >2014-10-05 13:52:27,762 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) Start initializing ResourceManager >2014-10-05 13:52:28,033 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2014-10-05 13:52:28,081 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.35.97.36,54,321) >2014-10-05 13:52:28,324 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added to the Resource Manager >2014-10-05 13:52:28,324 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2014-10-05 13:52:28,342 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.35.64.85,54,321) >2014-10-05 13:52:28,359 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS a6249d4e-b23d-4a14-9f56-a0761d824721 was added to the Resource Manager >2014-10-05 13:52:28,396 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) Finished initializing ResourceManager >2014-10-05 13:52:28,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 38) Initialization of OvfDataUpdater completed successfully. >2014-10-05 13:52:28,406 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Start scheduling to enable vds load balancer >2014-10-05 13:52:28,407 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Finished scheduling to enable vds load balancer >2014-10-05 13:52:28,407 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Start HA Reservation check >2014-10-05 13:52:28,407 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Finished HA Reservation check >2014-10-05 13:52:28,435 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) Init VM custom properties utilities >2014-10-05 13:52:28,437 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) Init device custom properties utilities >2014-10-05 13:52:28,447 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Initializing Scheduling manager >2014-10-05 13:52:28,451 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(776c4cd7): Start initializing >2014-10-05 13:52:28,502 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(776c4cd7): Finished initializing. Available MACs in pool: 256 >2014-10-05 13:52:28,530 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) External scheduler disabled, discovery skipped >2014-10-05 13:52:28,530 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Initialized Scheduling manager >2014-10-05 13:52:28,530 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 38) Initializing DWH Heart Beat >2014-10-05 13:52:28,534 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 38) DWH Heart Beat initialized >2014-10-05 13:52:33,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 8a07b6c >2014-10-05 13:52:33,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721]), log id: 69464677 >2014-10-05 13:52:34,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: 69464677 >2014-10-05 13:52:34,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 8a07b6c >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: UNASSIGNED not exist in string table >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-05 13:52:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_STOPPED not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_STARTED not exist in string table >2014-10-05 13:52:34,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_ERROR not exist in string table >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-10-05 13:52:34,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-10-05 13:52:34,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,237 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,237 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,237 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,237 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,237 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 13:52:34,329 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 13:52:34,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_2. >2014-10-05 13:52:34,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-6) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=78012759-feaf-418a-88bb-55527c8140c8, force=false, secondsToWait=0, gracefully=false), log id: 38f30d2b >2014-10-05 13:52:34,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, DestroyVDSCommand, log id: 38f30d2b >2014-10-05 13:52:34,593 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = PoweringUp on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 13:52:34,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down. Exit message: internal error Failed to acquire lock: error -243. >2014-10-05 13:52:34,797 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM HostedEngine (78012759-feaf-418a-88bb-55527c8140c8) is running in db and not running in VDS hosted_engine_1 >2014-10-05 13:52:34,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 3649f60b >2014-10-05 13:52:34,823 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Initializing Host: hosted_engine_2 >2014-10-05 13:52:34,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) FINISH, FullListVdsCommand, return: [], log id: 3649f60b >2014-10-05 13:52:34,965 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [687e4f13] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 13:52:34,985 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 >2014-10-05 13:52:34,991 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [42048907] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 13:52:35,044 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-12) [5999920a] Running command: ProcessDownVmCommand internal: true. >2014-10-05 13:52:35,086 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-14) [6cd22138] Running command: ProcessDownVmCommand internal: true. >2014-10-05 13:52:38,227 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 2821f5ce >2014-10-05 13:52:38,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, displayIp=0, pauseCode=NOERR, display=vnc, pid=29035, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, clientIp=, vmId=78012759-feaf-418a-88bb-55527c8140c8, devices=[Ljava.lang.Object;@36262303, vmName=HostedEngine, cpuType=Conroe}], log id: 2821f5ce >2014-10-05 13:52:38,328 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) Received a console Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=console0, specParams={}, device=console, type=console, deviceId=c95bddaf-9b44-4e16-9de8-799acd0ee966} >2014-10-05 13:52:38,329 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) Received a memballoon Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-10-05 13:52:38,329 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) Empty or NULL values were passed for a VM 78012759-feaf-418a-88bb-55527c8140c8 device, Device is skipped >2014-10-05 13:52:41,454 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) VM HostedEngine 78012759-feaf-418a-88bb-55527c8140c8 moved from PoweringUp --> Up >2014-10-05 13:52:41,829 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-1) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-10-05 13:52:41,847 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-1) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-10-05 13:52:49,501 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginAdminUserCommand internal: false. >2014-10-05 13:52:49,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-05 13:52:50,383 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-1) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-10-05 13:52:52,176 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginUserCommand internal: false. >2014-10-05 13:56:21,307 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [1b3d2041] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-05 13:56:21,347 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [1b3d2041] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:21,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [1b3d2041] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3aa7c520 >2014-10-05 13:56:21,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [1b3d2041] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 3aa7c520 >2014-10-05 13:56:21,514 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [1b3d2041] Lock freed to object EngineLock [exclusiveLocks= key: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-05 13:56:21,658 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [326152d3] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:21,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47daa20c >2014-10-05 13:56:21,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 47daa20c >2014-10-05 13:56:21,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] START, CreateStorageDomainVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@da7d1e93, args=10.35.160.108:/RHEV/artyom_hosted_engine_storage_34), log id: 21b02569 >2014-10-05 13:56:22,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] FINISH, CreateStorageDomainVDSCommand, log id: 21b02569 >2014-10-05 13:56:22,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storageDomainId=12a6a966-7a3e-4fcb-94d2-4ff58271527d), log id: 57e86ab6 >2014-10-05 13:56:22,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-5) [326152d3] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@b27439ec, log id: 57e86ab6 >2014-10-05 13:56:22,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [326152d3] Correlation ID: 326152d3, Job ID: 44dcf450-8203-4ce9-a304-df195798f704, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sd_34 was added by admin >2014-10-05 13:56:22,512 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [57de5373] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:22,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [57de5373] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2fd7ad01 >2014-10-05 13:56:22,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [57de5373] FINISH, DisconnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 2fd7ad01 >2014-10-05 13:56:22,872 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-7) [5694a39] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 13:56:22,892 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-7) [351de03c] Lock Acquired to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000366 value: POOL >, sharedLocks= ] >2014-10-05 13:56:22,896 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-7) [351de03c] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 13:56:23,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:23,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e26802f >2014-10-05 13:56:23,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 6e26802f >2014-10-05 13:56:23,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] START, CreateStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId=00000002-0002-0002-0002-000000000366, storagePoolName=Default, masterDomainId=12a6a966-7a3e-4fcb-94d2-4ff58271527d, domainsIdList=[12a6a966-7a3e-4fcb-94d2-4ff58271527d], masterVersion=1), log id: 389e503f >2014-10-05 13:56:46,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] FINISH, CreateStoragePoolVDSCommand, log id: 389e503f >2014-10-05 13:56:46,422 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-7) [7ddf5a42] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000366 value: POOL >, sharedLocks= ] >2014-10-05 13:56:46,426 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [36a5cff2] Lock Acquired to object EngineLock [exclusiveLocks= key: 12a6a966-7a3e-4fcb-94d2-4ff58271527d value: STORAGE >, sharedLocks= ] >2014-10-05 13:56:46,437 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [36a5cff2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 13:56:46,464 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [36a5cff2] Lock freed to object EngineLock [exclusiveLocks= key: 12a6a966-7a3e-4fcb-94d2-4ff58271527d value: STORAGE >, sharedLocks= ] >2014-10-05 13:56:46,465 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [36a5cff2] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/5/14 1:56 PM >2014-10-05 13:56:46,473 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [81bb31f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:46,475 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4b1ec407] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-05 13:56:46,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [81bb31f] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2b11960a >2014-10-05 13:56:46,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4b1ec407] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4448d638 >2014-10-05 13:56:46,484 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 0 tasks in the queue. >2014-10-05 13:56:46,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4b1ec407] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 4448d638 >2014-10-05 13:56:46,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [81bb31f] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 2b11960a >2014-10-05 13:56:46,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [36a5cff2] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d), log id: 75fc3111 >2014-10-05 13:56:46,738 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 13:56:46,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3ddf414a] Correlation ID: 3ddf414a, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-10-05 13:56:46,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] hostFromVds::selectedVds - hosted_engine_1, spmStatus Unknown_Pool, storage pool Default >2014-10-05 13:56:46,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 63201c1a >2014-10-05 13:56:47,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] FINISH, ConnectStoragePoolVDSCommand, log id: 63201c1a >2014-10-05 13:56:47,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] hostFromVds::Connected host to pool - selectedVds - hosted_engine_1, spmStatus Free, storage pool Default >2014-10-05 13:56:47,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] starting spm on vds hosted_engine_1, storage pool Default, prevId -1, LVER -1 >2014-10-05 13:56:47,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] START, SpmStartVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4e2114e4 >2014-10-05 13:56:47,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] spmStart polling started: taskId = f5c8efd8-1009-4c65-b9ea-bdd48a4cd76c >2014-10-05 13:57:08,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] spmStart polling ended: taskId = f5c8efd8-1009-4c65-b9ea-bdd48a4cd76c task status = finished >2014-10-05 13:57:08,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] spmStart polling ended, spm status: SPM >2014-10-05 13:57:08,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, taskId=f5c8efd8-1009-4c65-b9ea-bdd48a4cd76c), log id: 4e607528 >2014-10-05 13:57:08,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] FINISH, HSMClearTaskVDSCommand, log id: 4e607528 >2014-10-05 13:57:08,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@f38e35d, log id: 4e2114e4 >2014-10-05 13:57:08,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] Initialize Irs proxy from vds: 10.35.97.36 >2014-10-05 13:57:08,883 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3ddf414a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_1 (Address: 10.35.97.36). >2014-10-05 13:57:08,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] FINISH, ActivateStorageDomainVDSCommand, log id: 75fc3111 >2014-10-05 13:57:08,974 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] ActivateStorage Domain. After Connect all hosts to pool. Time:10/5/14 1:57 PM >2014-10-05 13:57:08,977 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 13:57:08,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [3ddf414a] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 2, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 4d1ce438 >2014-10-05 13:57:08,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) [3ddf414a] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 733827aa >2014-10-05 13:57:09,226 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) [3ddf414a] FINISH, ConnectStoragePoolVDSCommand, log id: 733827aa >2014-10-05 13:57:09,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [3ddf414a] FINISH, ConnectStoragePoolVDSCommand, log id: 4d1ce438 >2014-10-05 13:57:09,585 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [3ddf414a] ActivateStorage Domain. After change storage pool status in vds. Time:10/5/14 1:57 PM >2014-10-05 13:57:09,598 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3ddf414a] Correlation ID: 36a5cff2, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sd_34 (Data Center Default) was activated by admin >2014-10-05 13:57:09,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3ddf414a] Correlation ID: 351de03c, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center Default by admin >2014-10-05 13:57:09,621 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3ddf414a] Correlation ID: 5694a39, Job ID: abe76077-e976-476a-ae2e-fdbfe84438ec, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sd_34 was attached to Data Center Default by admin >2014-10-05 14:00:45,465 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [6ab10b97] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:00:45,538 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [6ab10b97] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 14:00:45,857 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [6ab10b97] Correlation ID: 6ab10b97, Job ID: 60c0f10e-a226-4ac9-ba9e-3a2cc15f7f97, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was created by admin. >2014-10-05 14:00:45,868 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [6ab10b97] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:00:46,413 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [1d5c0128] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM, ID: 0000000e-000e-000e-000e-0000000000ae Type: VnicProfile >2014-10-05 14:00:46,538 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [1ecd5c35] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:00:46,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [1ecd5c35] Correlation ID: 1ecd5c35, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM test_affinity_1. (User: admin) >2014-10-05 14:00:46,637 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [1ecd5c35] Correlation ID: 1d5c0128, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM test_affinity_1. (User: admin) >2014-10-05 14:00:46,739 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-8) [7bcb3c92] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:00:49,309 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [6b56c15e] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM_DISK_BOOT >, sharedLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >] >2014-10-05 14:00:49,358 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [6b56c15e] Running command: AddDiskCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM, ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 14:00:49,502 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [61a3380f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 14:00:49,572 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [61a3380f] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM_DISK_BOOT >, sharedLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >] >2014-10-05 14:00:49,573 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [61a3380f] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageGroupId = e3455527-bada-4b75-b50b-09b6922833da, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 1c4a67d1-bb48-4298-8e6d-982cac570b9c, newImageDescription = ), log id: 52e09e18 >2014-10-05 14:00:49,574 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [61a3380f] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-05 14:00:49,695 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [61a3380f] FINISH, CreateImageVDSCommand, return: 1c4a67d1-bb48-4298-8e6d-982cac570b9c, log id: 52e09e18 >2014-10-05 14:00:49,861 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [61a3380f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 3912ba93-d229-425b-8975-568b8f513bbf >2014-10-05 14:00:49,862 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [61a3380f] CommandMultiAsyncTasks::AttachTask: Attaching task df0d5056-067f-498c-8f4e-96072cb1332c to command 3912ba93-d229-425b-8975-568b8f513bbf. >2014-10-05 14:00:49,896 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [61a3380f] Adding task df0d5056-067f-498c-8f4e-96072cb1332c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-05 14:00:49,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [61a3380f] Correlation ID: 6b56c15e, Job ID: 26b9d32c-b253-4609-bbdd-f2915287293a, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of test_affinity_1_Disk1 was initiated on VM test_affinity_1 by admin. >2014-10-05 14:00:49,941 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [61a3380f] BaseAsyncTask::startPollingTask: Starting to poll task df0d5056-067f-498c-8f4e-96072cb1332c. >2014-10-05 14:00:57,774 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-97) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-10-05 14:00:57,816 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) SPMAsyncTask::PollTask: Polling task df0d5056-067f-498c-8f4e-96072cb1332c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-05 14:00:57,828 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) BaseAsyncTask::OnTaskEndSuccess: Task df0d5056-067f-498c-8f4e-96072cb1332c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-05 14:00:57,829 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-97) CommandAsyncTask::EndActionIfNecessary: All tasks of command 3912ba93-d229-425b-8975-568b8f513bbf has ended -> executing endAction >2014-10-05 14:00:57,829 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-97) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 3912ba93-d229-425b-8975-568b8f513bbf): calling endAction . >2014-10-05 14:00:57,830 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-36) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-05 14:00:57,857 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-36) [6b56c15e] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-05 14:00:57,864 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-36) [61a3380f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-05 14:00:57,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-36) [61a3380f] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageGroupId = e3455527-bada-4b75-b50b-09b6922833da, imageId = 1c4a67d1-bb48-4298-8e6d-982cac570b9c), log id: 30a497cc >2014-10-05 14:00:57,952 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-36) [61a3380f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a7d1cf58, log id: 30a497cc >2014-10-05 14:00:58,028 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [26d6ade6] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_2 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:00:58,055 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) Correlation ID: 6b56c15e, Job ID: 26b9d32c-b253-4609-bbdd-f2915287293a, Call Stack: null, Custom Event ID: -1, Message: The disk test_affinity_1_Disk1 was successfully added to VM test_affinity_1. >2014-10-05 14:00:58,055 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-05 14:00:58,056 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-05 14:00:58,068 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-36) SPMAsyncTask::ClearAsyncTask: Attempting to clear task df0d5056-067f-498c-8f4e-96072cb1332c >2014-10-05 14:00:58,069 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-36) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, taskId = df0d5056-067f-498c-8f4e-96072cb1332c), log id: 4b7fcbad >2014-10-05 14:00:58,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-36) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, taskId=df0d5056-067f-498c-8f4e-96072cb1332c), log id: de31110 >2014-10-05 14:00:58,087 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [26d6ade6] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 14:00:58,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-36) FINISH, HSMClearTaskVDSCommand, log id: de31110 >2014-10-05 14:00:58,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-36) FINISH, SPMClearTaskVDSCommand, log id: 4b7fcbad >2014-10-05 14:00:58,136 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-36) BaseAsyncTask::RemoveTaskFromDB: Removed task df0d5056-067f-498c-8f4e-96072cb1332c from DataBase >2014-10-05 14:00:58,137 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 3912ba93-d229-425b-8975-568b8f513bbf >2014-10-05 14:00:58,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [26d6ade6] Correlation ID: 26d6ade6, Job ID: bc14fb2f-9947-4018-8491-e2863d3e7aec, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was created by admin. >2014-10-05 14:00:58,209 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [26d6ade6] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_2 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:00:58,798 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-1) [38390448] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM, ID: 0000000e-000e-000e-000e-0000000000ae Type: VnicProfile >2014-10-05 14:00:58,877 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-1) [504be7c2] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:00:58,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [504be7c2] Correlation ID: 504be7c2, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM test_affinity_2. (User: admin) >2014-10-05 14:00:58,976 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [504be7c2] Correlation ID: 38390448, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM test_affinity_2. (User: admin) >2014-10-05 14:00:59,057 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-8) [34f6f4b5] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:01:01,037 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [3d48dcc0] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM_DISK_BOOT >, sharedLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >] >2014-10-05 14:01:01,065 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [3d48dcc0] Running command: AddDiskCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM, ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 14:01:01,138 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [66a0bda3] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 12a6a966-7a3e-4fcb-94d2-4ff58271527d Type: Storage >2014-10-05 14:01:01,165 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [66a0bda3] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM_DISK_BOOT >, sharedLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >] >2014-10-05 14:01:01,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [66a0bda3] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageGroupId = 4e31448a-d9e6-4fb1-900d-8c278483aa80, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = b1d5b60f-5b16-4960-8206-82e7211288a8, newImageDescription = ), log id: 4de9deec >2014-10-05 14:01:01,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [66a0bda3] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-05 14:01:01,274 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [66a0bda3] FINISH, CreateImageVDSCommand, return: b1d5b60f-5b16-4960-8206-82e7211288a8, log id: 4de9deec >2014-10-05 14:01:01,285 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [66a0bda3] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command e09de2b3-b9c5-452a-9795-123bb8bd76dc >2014-10-05 14:01:01,285 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [66a0bda3] CommandMultiAsyncTasks::AttachTask: Attaching task 31f360c2-fbdb-46ff-b63a-d99bc24af872 to command e09de2b3-b9c5-452a-9795-123bb8bd76dc. >2014-10-05 14:01:01,299 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [66a0bda3] Adding task 31f360c2-fbdb-46ff-b63a-d99bc24af872 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-05 14:01:01,327 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [66a0bda3] Correlation ID: 3d48dcc0, Job ID: de49eaa2-fc52-4937-85ed-2fe31f5e2715, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of test_affinity_2_Disk1 was initiated on VM test_affinity_2 by admin. >2014-10-05 14:01:01,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [66a0bda3] BaseAsyncTask::startPollingTask: Starting to poll task 31f360c2-fbdb-46ff-b63a-d99bc24af872. >2014-10-05 14:01:07,831 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-10-05 14:01:07,857 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) SPMAsyncTask::PollTask: Polling task 31f360c2-fbdb-46ff-b63a-d99bc24af872 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-05 14:01:07,863 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) BaseAsyncTask::OnTaskEndSuccess: Task 31f360c2-fbdb-46ff-b63a-d99bc24af872 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-05 14:01:07,864 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) CommandAsyncTask::EndActionIfNecessary: All tasks of command e09de2b3-b9c5-452a-9795-123bb8bd76dc has ended -> executing endAction >2014-10-05 14:01:07,864 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: e09de2b3-b9c5-452a-9795-123bb8bd76dc): calling endAction . >2014-10-05 14:01:07,864 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-12) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-05 14:01:07,877 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-12) [3d48dcc0] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-05 14:01:07,881 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-12) [66a0bda3] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-05 14:01:07,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-12) [66a0bda3] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageGroupId = 4e31448a-d9e6-4fb1-900d-8c278483aa80, imageId = b1d5b60f-5b16-4960-8206-82e7211288a8), log id: 1c19a1a3 >2014-10-05 14:01:07,937 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-12) [66a0bda3] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@3c175af3, log id: 1c19a1a3 >2014-10-05 14:01:07,967 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) Correlation ID: 3d48dcc0, Job ID: de49eaa2-fc52-4937-85ed-2fe31f5e2715, Call Stack: null, Custom Event ID: -1, Message: The disk test_affinity_2_Disk1 was successfully added to VM test_affinity_2. >2014-10-05 14:01:07,967 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-05 14:01:07,967 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-05 14:01:07,973 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-12) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 31f360c2-fbdb-46ff-b63a-d99bc24af872 >2014-10-05 14:01:07,973 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-12) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, taskId = 31f360c2-fbdb-46ff-b63a-d99bc24af872), log id: 2345c9b3 >2014-10-05 14:01:07,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-12) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, taskId=31f360c2-fbdb-46ff-b63a-d99bc24af872), log id: 3abd18dc >2014-10-05 14:01:08,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-12) FINISH, HSMClearTaskVDSCommand, log id: 3abd18dc >2014-10-05 14:01:08,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-12) FINISH, SPMClearTaskVDSCommand, log id: 2345c9b3 >2014-10-05 14:01:08,015 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-12) BaseAsyncTask::RemoveTaskFromDB: Removed task 31f360c2-fbdb-46ff-b63a-d99bc24af872 from DataBase >2014-10-05 14:01:08,015 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity e09de2b3-b9c5-452a-9795-123bb8bd76dc >2014-10-05 14:01:21,212 INFO [org.ovirt.engine.core.bll.scheduling.commands.AddAffinityGroupCommand] (ajp-/127.0.0.1:8702-5) [3a38e768] Running command: AddAffinityGroupCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 14:01:21,226 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [3a38e768] No severity for USER_ADDED_AFFINITY_GROUP audit log type, assuming Normal severity >2014-10-05 14:01:21,237 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [3a38e768] Correlation ID: 3a38e768, Call Stack: null, Custom Event ID: -1, Message: Affinity Group test was added. (User: admin) >2014-10-05 14:02:19,453 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-10-05 14:02:19,463 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-05 14:02:27,742 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-3) Setting new tasks map. The map contains now 0 tasks >2014-10-05 14:02:27,742 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-3) Cleared all tasks of pool 00000002-0002-0002-0002-000000000366. >2014-10-05 14:04:52,804 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:04:52,856 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 20fd0d5 >2014-10-05 14:04:52,856 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 20fd0d5 >2014-10-05 14:04:53,080 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] Running command: RunVmOnceCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM, ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:04:53,137 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 2fee69ae >2014-10-05 14:04:53,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 7a95057a >2014-10-05 14:04:53,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, bootOrder=1, iface=virtio, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {bootOrder=2, nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=3d012714-e7f5-4cde-9ee1-d61c0523ca35}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={} >2014-10-05 14:04:53,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] FINISH, CreateVDSCommand, log id: 7a95057a >2014-10-05 14:04:53,990 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2fee69ae >2014-10-05 14:04:53,990 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-6) [7cda933e] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:04:54,003 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [7cda933e] Correlation ID: 7cda933e, Job ID: 42097fbb-595d-428b-9fa6-2cb832b81796, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 14:04:57,341 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:04:57,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: b767dd5 >2014-10-05 14:04:57,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=11229, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@103f30d4, vmName=test_affinity_1, cpuType=Conroe}], log id: b767dd5 >2014-10-05 14:04:59,760 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [4d7ede1c] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:04:59,777 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4d7ede1c] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 1924ed5f >2014-10-05 14:04:59,777 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4d7ede1c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1924ed5f >2014-10-05 14:04:59,812 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-3) [4d7ede1c] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups >2014-10-05 14:04:59,873 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:04:59,892 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 4d7ede1c) >2014-10-05 14:04:59,927 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 6b7d5704 >2014-10-05 14:04:59,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 49177f4e >2014-10-05 14:05:00,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, index=0, iface=virtio, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=00000002-0002-0002-0002-000000000366, format=raw, type=disk, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={} >2014-10-05 14:05:00,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] FINISH, CreateVDSCommand, log id: 49177f4e >2014-10-05 14:05:00,438 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6b7d5704 >2014-10-05 14:05:00,439 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:05:00,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [4d7ede1c] Correlation ID: 4d7ede1c, Job ID: 42e3ad64-b3dd-47cc-a924-cf7b3fa7af01, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_1). >2014-10-05 14:05:03,679 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-77) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:05:03,679 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 4b8156a1 >2014-10-05 14:05:03,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=11721, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@551f1dd9, vmName=test_affinity_2, cpuType=Conroe}], log id: 4b8156a1 >2014-10-05 14:05:54,070 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-95) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:05:54,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-95) Correlation ID: 7cda933e, Job ID: 42097fbb-595d-428b-9fa6-2cb832b81796, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 started on Host hosted_engine_1 >2014-10-05 14:06:03,390 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:06:03,406 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) Correlation ID: 4d7ede1c, Job ID: 42e3ad64-b3dd-47cc-a924-cf7b3fa7af01, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_1 >2014-10-05 14:06:12,578 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-1) [2a45169e] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000366 value: POOL >] >2014-10-05 14:06:12,627 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:06:12,630 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 35a4f1b >2014-10-05 14:06:12,630 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] VDS hosted_engine_1 is spm and moved from up calling resetIrs. >2014-10-05 14:06:12,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, vdsId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, ignoreStopFailed = false), log id: 2e79b44 >2014-10-05 14:06:12,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] START, SpmStopVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366), log id: 30b21a78 >2014-10-05 14:06:12,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] SpmStopVDSCommand::Stopping SPM on vds hosted_engine_1, pool id 00000002-0002-0002-0002-000000000366 >2014-10-05 14:06:12,748 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] FINISH, SpmStopVDSCommand, log id: 30b21a78 >2014-10-05 14:06:12,755 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] FINISH, ResetIrsVDSCommand, log id: 2e79b44 >2014-10-05 14:06:12,766 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] FINISH, SetVdsStatusVDSCommand, log id: 35a4f1b >2014-10-05 14:06:12,817 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000366 value: POOL >] >2014-10-05 14:06:12,852 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:06:12,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 620247c1 >2014-10-05 14:06:12,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2a45169e] FINISH, SetHaMaintenanceModeVDSCommand, log id: 620247c1 >2014-10-05 14:06:12,917 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:06:12,960 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:06:13,009 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 51318190 >2014-10-05 14:06:13,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:06:13,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 55373d25 >2014-10-05 14:06:13,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] FINISH, MigrateBrokerVDSCommand, log id: 55373d25 >2014-10-05 14:06:13,081 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-26) [3b32fbf0] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 51318190 >2014-10-05 14:06:13,132 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:06:13,246 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:06:13,251 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:06:13,263 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-43) [63935c66] Storage Pool 00000002-0002-0002-0002-000000000366 - Updating Storage Domain 12a6a966-7a3e-4fcb-94d2-4ff58271527d status from Active to Unknown, reason : null >2014-10-05 14:06:13,300 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) [63935c66] Correlation ID: 63935c66, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-05 14:06:13,318 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 20d46f9e >2014-10-05 14:06:13,336 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:06:13,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] hostFromVds::selectedVds - hosted_engine_2, spmStatus Free, storage pool Default >2014-10-05 14:06:13,372 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] SPM Init: could not find reported vds or not up - pool:Default vds_spm_id: 1 >2014-10-05 14:06:13,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] SPM selection - vds seems as spm hosted_engine_1 >2014-10-05 14:06:13,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] START, SpmStopVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366), log id: d4bc322 >2014-10-05 14:06:13,394 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:06:13,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1d3dd073 >2014-10-05 14:06:13,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM]] > >2014-10-05 14:06:13,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] HostName = hosted_engine_1 >2014-10-05 14:06:13,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] FINISH, MigrateBrokerVDSCommand, log id: 1d3dd073 >2014-10-05 14:06:13,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] Command HSMGetAllTasksStatusesVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726) execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM >2014-10-05 14:06:13,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] FINISH, SpmStopVDSCommand, log id: d4bc322 >2014-10-05 14:06:13,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] spm stop succeeded, continuing with spm selection >2014-10-05 14:06:13,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] starting spm on vds hosted_engine_2, storage pool Default, prevId 1, LVER 0 >2014-10-05 14:06:13,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] START, SpmStartVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, storagePoolId = 00000002-0002-0002-0002-000000000366, prevId=1, prevLVER=0, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: 38565f6d >2014-10-05 14:06:13,473 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 20d46f9e >2014-10-05 14:06:13,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [4b52cebd] Correlation ID: 2a45169e, Job ID: 3f8938bb-b806-4cda-8eed-a6f1982d0044, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was switched to Maintenance mode by admin. >2014-10-05 14:06:13,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] spmStart polling started: taskId = 8a588cb4-6768-48e2-af2a-83fa7bdfcc2e >2014-10-05 14:06:14,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] spmStart polling ended: taskId = 8a588cb4-6768-48e2-af2a-83fa7bdfcc2e task status = finished >2014-10-05 14:06:14,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] spmStart polling ended, spm status: SPM >2014-10-05 14:06:14,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] START, HSMClearTaskVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, taskId=8a588cb4-6768-48e2-af2a-83fa7bdfcc2e), log id: 2b0b83e >2014-10-05 14:06:14,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] FINISH, HSMClearTaskVDSCommand, log id: 2b0b83e >2014-10-05 14:06:14,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3235fc2e, log id: 38565f6d >2014-10-05 14:06:14,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] Initialize Irs proxy from vds: 10.35.64.85 >2014-10-05 14:06:14,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) [63935c66] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: 10.35.64.85). >2014-10-05 14:06:15,033 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [63935c66] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false), log id: 20411c8e >2014-10-05 14:06:15,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [63935c66] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000366 >2014-10-05 14:06:15,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [63935c66] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 495c0732 >2014-10-05 14:06:15,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [63935c66] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 495c0732 >2014-10-05 14:06:15,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [63935c66] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 20411c8e >2014-10-05 14:06:15,112 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-49) [63935c66] Discovered no tasks on Storage Pool Default >2014-10-05 14:06:16,453 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:06:16,454 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:06:17,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-49) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 6546a41d >2014-10-05 14:06:17,770 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, DestroyVDSCommand, log id: 6546a41d >2014-10-05 14:06:17,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-49) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 9f743f1 >2014-10-05 14:06:17,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, DestroyVDSCommand, log id: 9f743f1 >2014-10-05 14:06:17,842 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) Handing over VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:06:17,842 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:06:17,844 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) Handing over VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:06:17,844 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:06:19,566 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-10) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingTo --> Up >2014-10-05 14:06:19,566 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-10) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingTo --> Up >2014-10-05 14:06:19,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-10) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae, efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 2fb0951d >2014-10-05 14:06:19,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-10) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5901, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=28018, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@720dbb60, vmName=test_affinity_2, cpuType=Conroe}, {displaySecurePort=5904, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5903, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=28160, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6388d61f, vmName=test_affinity_1, cpuType=Conroe}], log id: 2fb0951d >2014-10-05 14:06:19,845 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-10) Correlation ID: 4b52cebd, Job ID: 3f8938bb-b806-4cda-8eed-a6f1982d0044, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 6 sec). >2014-10-05 14:06:19,845 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-10) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:06:19,865 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-10) Correlation ID: 3b32fbf0, Job ID: 3f8938bb-b806-4cda-8eed-a6f1982d0044, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 6 sec). >2014-10-05 14:06:19,865 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-10) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:06:20,991 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 25466fb3-6dfd-4f53-82ce-c622f4ab7726 : hosted_engine_1 >2014-10-05 14:06:21,009 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-25) Clearing cache of pool: 00000002-0002-0002-0002-000000000366 for problematic entities of VDS: hosted_engine_1. >2014-10-05 14:06:21,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-58) START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1), log id: 30c59489 >2014-10-05 14:06:25,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, DisconnectStoragePoolVDSCommand, log id: 30c59489 >2014-10-05 14:06:25,104 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-58) [c0c7d94] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:06:25,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-58) [c0c7d94] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16b1f898 >2014-10-05 14:06:25,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-58) [c0c7d94] FINISH, DisconnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 16b1f898 >2014-10-05 14:06:39,857 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-6) [43c15b8f] Lock Acquired to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:06:39,888 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:06:39,888 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Before acquiring lock in order to prevent monitoring for host hosted_engine_1 from data-center Default >2014-10-05 14:06:39,888 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_1 from data-center Default >2014-10-05 14:06:39,900 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1da24d6a >2014-10-05 14:06:39,910 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] FINISH, SetVdsStatusVDSCommand, log id: 1da24d6a >2014-10-05 14:06:39,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 2bc3e52c >2014-10-05 14:06:39,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] FINISH, SetHaMaintenanceModeVDSCommand, log id: 2bc3e52c >2014-10-05 14:06:39,953 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Activate finished. Lock released. Monitoring can run now for host hosted_engine_1 from data-center Default >2014-10-05 14:06:39,964 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Correlation ID: 43c15b8f, Job ID: 92955b3d-0d5e-4993-9321-84cdd853eb4c, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was activated by admin. >2014-10-05 14:06:39,972 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-48) [43c15b8f] Lock freed to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:06:40,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 676430eb >2014-10-05 14:06:40,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 676430eb >2014-10-05 14:06:42,988 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-5) [1ecb7559] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:06:43,001 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) [1ecb7559] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 14:06:43,029 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-5) [25fb66b5] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:06:43,040 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:06:43,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 24e99fda >2014-10-05 14:06:43,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 24e99fda >2014-10-05 14:06:43,229 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] Host hosted_engine_1 storage connection was succeeded >2014-10-05 14:06:43,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 100e2b6f >2014-10-05 14:06:43,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) FINISH, ConnectStoragePoolVDSCommand, log id: 100e2b6f >2014-10-05 14:06:43,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 693b49df >2014-10-05 14:06:43,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-5) [473ec50f] FINISH, SetMOMPolicyParametersVDSCommand, log id: 693b49df >2014-10-05 14:06:43,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) [473ec50f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. >2014-10-05 14:06:43,741 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [2f317f05] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:20:29,051 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:29:00,330 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [2d7e1e94] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000003c6 Type: VdsGroups >2014-10-05 14:29:00,394 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [524389f] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:29:00,413 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [524389f] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000366 value: REGISTER_VDS >, sharedLocks= ] >2014-10-05 14:29:00,416 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] START, RemoveVdsVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 423da62 >2014-10-05 14:29:00,416 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] FINISH, RemoveVdsVDSCommand, log id: 423da62 >2014-10-05 14:29:00,418 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] START, AddVdsVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 7cf544b3 >2014-10-05 14:29:00,418 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] AddVds - entered , starting logic to add VDS 27d8f2a3-df14-411c-9163-dead0f6754e4 >2014-10-05 14:29:00,420 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] AddVds - VDS 27d8f2a3-df14-411c-9163-dead0f6754e4 was added, will try to add it to the resource manager >2014-10-05 14:29:00,420 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [524389f] Entered VdsManager constructor >2014-10-05 14:29:00,443 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [524389f] Initialize vdsBroker (puma16.scl.lab.tlv.redhat.com,54,321) >2014-10-05 14:29:00,444 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [524389f] VDS 27d8f2a3-df14-411c-9163-dead0f6754e4 was added to the Resource Manager >2014-10-05 14:29:00,444 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [524389f] FINISH, AddVdsVDSCommand, log id: 7cf544b3 >2014-10-05 14:29:00,456 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [524389f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:29:00,490 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Lock Acquired to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:29:00,499 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [524389f] Correlation ID: 2d7e1e94, Job ID: ef16e686-1746-4721-a083-c590431b49f5, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com was added by admin. >2014-10-05 14:29:00,502 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Running command: InstallVdsCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:29:00,519 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Before Installation host 27d8f2a3-df14-411c-9163-dead0f6754e4, puma16.scl.lab.tlv.redhat.com >2014-10-05 14:29:00,525 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] START, SetVdsStatusVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 66cadfd4 >2014-10-05 14:29:00,536 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] FINISH, SetVdsStatusVDSCommand, log id: 66cadfd4 >2014-10-05 14:29:00,644 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-28) [69f6391] Installation puma16.scl.lab.tlv.redhat.com: Connected to host puma16.scl.lab.tlv.redhat.com with SSH key fingerprint: 79:ad:f7:07:69:8f:8e:e9:8f:11:e6:79:95:e3:98:f8 >2014-10-05 14:29:00,653 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [69f6391] Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Connected to host puma16.scl.lab.tlv.redhat.com with SSH key fingerprint: 79:ad:f7:07:69:8f:8e:e9:8f:11:e6:79:95:e3:98:f8. >2014-10-05 14:29:00,688 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-28) [69f6391] Installation of puma16.scl.lab.tlv.redhat.com. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-05 14:29:00,728 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-28) SSH execute root@puma16.scl.lab.tlv.redhat.com 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-05 14:29:01,998 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Initializing >2014-10-05 14:29:02,013 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Initializing. >2014-10-05 14:29:02,031 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Environment setup >2014-10-05 14:29:02,052 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Environment setup. >2014-10-05 14:29:02,052 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Environment packages setup >2014-10-05 14:29:02,067 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Environment packages setup. >2014-10-05 14:29:03,447 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) Initializing Host: puma16.scl.lab.tlv.redhat.com >2014-10-05 14:29:04,790 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Programs detection >2014-10-05 14:29:04,798 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Programs detection. >2014-10-05 14:29:04,799 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Environment customization >2014-10-05 14:29:04,806 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Environment customization. >2014-10-05 14:29:04,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20141005143056-9i6edv.log' >2014-10-05 14:29:04,869 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20141005143056-9i6edv.log'. >2014-10-05 14:29:04,919 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host puma16.scl.lab.tlv.redhat.com reports unique id bf5176e3-3776-4df2-99c2-e0f10df24da6 >2014-10-05 14:29:04,922 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id bf5176e3-3776-4df2-99c2-e0f10df24da6 to Host puma16.scl.lab.tlv.redhat.com >2014-10-05 14:29:05,015 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Setup validation >2014-10-05 14:29:05,023 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Setup validation. >2014-10-05 14:29:05,308 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Hardware supports virtualization >2014-10-05 14:29:05,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Hardware supports virtualization. >2014-10-05 14:29:05,457 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Transaction setup >2014-10-05 14:29:05,464 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Transaction setup. >2014-10-05 14:29:05,490 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Misc configuration >2014-10-05 14:29:05,497 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Misc configuration. >2014-10-05 14:29:05,497 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Package installation >2014-10-05 14:29:05,504 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Package installation. >2014-10-05 14:29:16,977 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Misc configuration >2014-10-05 14:29:16,986 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Misc configuration. >2014-10-05 14:29:17,083 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Setting time >2014-10-05 14:29:17,091 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Setting time. >2014-10-05 14:29:20,097 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Enrolling certificate >2014-10-05 14:29:20,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Enrolling certificate. >2014-10-05 14:29:21,641 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-25) [4be1c625] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:29:21,641 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [23e692e5] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:29:21,671 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-25) [4be1c625] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:29:21,672 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [23e692e5] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:29:21,706 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:29:21,708 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] Entered (VM test_affinity_2). >2014-10-05 14:29:21,708 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] Sending shutdown command for VM test_affinity_2. >2014-10-05 14:29:21,710 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 156eef55 >2014-10-05 14:29:21,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 5a45783f >2014-10-05 14:29:21,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] FINISH, DestroyVDSCommand, log id: 5a45783f >2014-10-05 14:29:21,788 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4be1c625] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 156eef55 >2014-10-05 14:29:21,801 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [4be1c625] Correlation ID: 4be1c625, Job ID: 8a078243-fab0-4e11-a14b-4f7049f4cb17, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_2). >2014-10-05 14:29:21,828 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:29:21,831 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] Entered (VM test_affinity_1). >2014-10-05 14:29:21,831 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] Sending shutdown command for VM test_affinity_1. >2014-10-05 14:29:21,833 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 9b849dc >2014-10-05 14:29:21,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 6b9b7048 >2014-10-05 14:29:21,861 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Transaction commit >2014-10-05 14:29:21,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Transaction commit. >2014-10-05 14:29:21,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] FINISH, DestroyVDSCommand, log id: 6b9b7048 >2014-10-05 14:29:21,896 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Closing up >2014-10-05 14:29:21,903 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [23e692e5] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 9b849dc >2014-10-05 14:29:21,905 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Closing up. >2014-10-05 14:29:21,914 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [23e692e5] Correlation ID: 23e692e5, Job ID: 7ef543a8-fb3c-458f-8997-93127fa7f9ee, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_2). >2014-10-05 14:29:22,530 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Restarting nrpe service >2014-10-05 14:29:22,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Restarting nrpe service. >2014-10-05 14:29:23,715 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stopping libvirtd >2014-10-05 14:29:23,723 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stopping libvirtd. >2014-10-05 14:29:23,816 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Starting vdsm >2014-10-05 14:29:23,823 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Starting vdsm. >2014-10-05 14:29:26,694 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Pre-termination >2014-10-05 14:29:26,701 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Pre-termination. >2014-10-05 14:29:26,718 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005142926-puma16.scl.lab.tlv.redhat.com-69f6391.log' >2014-10-05 14:29:26,725 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141005142926-puma16.scl.lab.tlv.redhat.com-69f6391.log'. >2014-10-05 14:29:27,104 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation puma16.scl.lab.tlv.redhat.com: Stage: Termination >2014-10-05 14:29:27,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 69f6391, Call Stack: null, Custom Event ID: -1, Message: Installing Host puma16.scl.lab.tlv.redhat.com. Stage: Termination. >2014-10-05 14:29:27,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 14:29:27,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Command PollVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 14:29:27,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 14:29:27,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Command PollVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-05 14:29:28,401 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 14:29:28,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Command PollVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 14:29:28,922 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 14:29:28,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Command PollVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-05 14:29:29,118 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:29:29,119 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-26) [48391aab] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:29:29,119 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-48) [1d05f598] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:29:29,123 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-48) [1d05f598] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:29:29,123 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-26) [48391aab] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:29:29,147 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [48391aab] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:29:29,149 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [48391aab] Entered (VM test_affinity_2). >2014-10-05 14:29:29,149 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [48391aab] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 14:29:29,207 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-47) [73d93c95] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:29:29,211 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [73d93c95] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 72deb570 >2014-10-05 14:29:29,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-47) [73d93c95] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 3ef09093 >2014-10-05 14:29:29,443 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-28) [69f6391] Engine managed to communicate with VDSM agent on host puma16.scl.lab.tlv.redhat.com >2014-10-05 14:29:29,766 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-47) [73d93c95] FINISH, DestroyVDSCommand, log id: 3ef09093 >2014-10-05 14:29:29,775 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] START, SetVdsStatusVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4ab42fcc >2014-10-05 14:29:29,787 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [73d93c95] FINISH, DestroyVmVDSCommand, return: Down, log id: 72deb570 >2014-10-05 14:29:29,787 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-5) [4ce7289d] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:29:29,805 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] FINISH, SetVdsStatusVDSCommand, log id: 4ab42fcc >2014-10-05 14:29:29,805 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] After Installation host puma16.scl.lab.tlv.redhat.com, VDS >2014-10-05 14:29:29,822 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [73d93c95] Correlation ID: 73d93c95, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:29:29,824 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [69f6391] Correlation ID: 69f6391, Job ID: ef16e686-1746-4721-a083-c590431b49f5, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com installed >2014-10-05 14:29:29,838 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [69f6391] Lock freed to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:29:29,867 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [1d05f598] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:29:29,869 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [1d05f598] Entered (VM test_affinity_1). >2014-10-05 14:29:29,869 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-47) [1d05f598] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 14:29:29,873 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-47) [604273e] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:29:29,876 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [604273e] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 5b3457a7 >2014-10-05 14:29:30,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-47) [604273e] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 1d992620 >2014-10-05 14:29:30,022 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:29:30,023 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:29:30,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-47) [604273e] FINISH, DestroyVDSCommand, log id: 1d992620 >2014-10-05 14:29:30,466 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-15) [3df94f06] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:29:30,466 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [604273e] FINISH, DestroyVmVDSCommand, return: Down, log id: 5b3457a7 >2014-10-05 14:29:30,488 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [604273e] Correlation ID: 604273e, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:29:30,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GetHardwareInfoVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vds=Host[puma16.scl.lab.tlv.redhat.com,27d8f2a3-df14-411c-9163-dead0f6754e4]), log id: 4ef12dcf >2014-10-05 14:29:30,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GetHardwareInfoVDSCommand, log id: 4ef12dcf >2014-10-05 14:29:30,719 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-40) [15d457ae] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:29:30,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [15d457ae] START, GetHardwareInfoVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vds=Host[puma16.scl.lab.tlv.redhat.com,27d8f2a3-df14-411c-9163-dead0f6754e4]), log id: 3aa24a78 >2014-10-05 14:29:30,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [15d457ae] FINISH, GetHardwareInfoVDSCommand, log id: 3aa24a78 >2014-10-05 14:29:30,915 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) [15d457ae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:29:30,932 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-40) [4f2506de] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:29:30,938 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:29:30,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] START, ConnectStorageServerVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6bf47165 >2014-10-05 14:29:31,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 6bf47165 >2014-10-05 14:29:31,296 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] Host puma16.scl.lab.tlv.redhat.com storage connection was succeeded >2014-10-05 14:29:31,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-16) START, ConnectStoragePoolVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 3, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 4b64fcb >2014-10-05 14:29:32,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-16) FINISH, ConnectStoragePoolVDSCommand, log id: 4b64fcb >2014-10-05 14:29:32,193 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] START, SetMOMPolicyParametersVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 2b291673 >2014-10-05 14:29:32,385 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-40) [44705f42] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2b291673 >2014-10-05 14:29:32,393 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) [44705f42] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:29:32,405 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-40) [79f375de] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:29:32,410 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-40) [22468763] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:29:48,569 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [4ffc51da] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:29:48,608 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [4ffc51da] Running command: UpdateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM, ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:29:48,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [4ffc51da] Correlation ID: 4ffc51da, Job ID: b7bd8ac1-77d0-4eb0-8c14-2b6faa0ef6f1, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 configuration was updated by admin. >2014-10-05 14:29:48,692 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [4ffc51da] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:29:50,352 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-4) [3cd0b0b0] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:29:50,387 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [3cd0b0b0] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 7beaf135 >2014-10-05 14:29:50,387 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [3cd0b0b0] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7beaf135 >2014-10-05 14:29:50,473 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:29:50,531 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 120403c2 >2014-10-05 14:29:50,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 103222cb >2014-10-05 14:29:51,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-05 14:29:51,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] FINISH, CreateVDSCommand, log id: 103222cb >2014-10-05 14:29:51,510 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 120403c2 >2014-10-05 14:29:51,510 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:29:51,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [3cd0b0b0] Correlation ID: 3cd0b0b0, Job ID: 7ba6d32c-ebfd-40f9-aa49-411d5bd5db84, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 14:29:51,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 7cb7a805 >2014-10-05 14:29:51,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=-1, smp=1, emulatedMachine=rhel6.5.0, status=WaitForLaunch, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=0, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@7d78203a, vmName=test_affinity_1, cpuType=Conroe}], log id: 7cb7a805 >2014-10-05 14:29:51,857 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) Received a memballoon Device without an address when processing VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae devices, skipping device: {specParams={model=virtio}, target=1048576, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16} >2014-10-05 14:29:53,909 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-4) [3643bbb3] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:29:53,925 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [3643bbb3] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 26dbdfd3 >2014-10-05 14:29:53,925 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [3643bbb3] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 26dbdfd3 >2014-10-05 14:29:53,969 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-4) [3643bbb3] Candidate host puma16.scl.lab.tlv.redhat.com (27d8f2a3-df14-411c-9163-dead0f6754e4) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups >2014-10-05 14:29:53,969 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-4) [3643bbb3] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups >2014-10-05 14:29:54,002 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:29:54,019 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] Candidate host puma16.scl.lab.tlv.redhat.com (27d8f2a3-df14-411c-9163-dead0f6754e4) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 3643bbb3) >2014-10-05 14:29:54,019 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 3643bbb3) >2014-10-05 14:29:54,039 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 2feb04da >2014-10-05 14:29:54,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 3435c2cf >2014-10-05 14:29:54,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9device_ee73fb22-9a76-44d7-aeaa-9ce0433e72ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ee73fb22-9a76-44d7-aeaa-9ce0433e72ca, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1dee2722-7136-47bd-b616-430685d94df9, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=194f2ed6-2427-4f3c-adb8-e41997d3c470, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13aceb=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=947b595f-fd1a-4a9d-906e-1b715c13aceb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=2da323f8-1e1e-49e6-b066-6bad97095871, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-10-05 14:29:54,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] FINISH, CreateVDSCommand, log id: 3435c2cf >2014-10-05 14:29:54,841 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2feb04da >2014-10-05 14:29:54,841 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:29:54,851 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [3643bbb3] Correlation ID: 3643bbb3, Job ID: 19d6e8a4-c1b4-4229-b813-8fa411e8dc06, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_1). >2014-10-05 14:29:54,951 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:29:54,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-12) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: f21b500 >2014-10-05 14:29:55,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-12) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=30689, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6df21ac2, vmName=test_affinity_1, cpuType=Conroe}], log id: f21b500 >2014-10-05 14:29:58,186 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:29:58,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 54bbf17 >2014-10-05 14:29:58,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9device_ee73fb22-9a76-44d7-aeaa-9ce0433e72ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ee73fb22-9a76-44d7-aeaa-9ce0433e72ca, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1dee2722-7136-47bd-b616-430685d94df9, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13aceb=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=947b595f-fd1a-4a9d-906e-1b715c13aceb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=194f2ed6-2427-4f3c-adb8-e41997d3c470, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=2da323f8-1e1e-49e6-b066-6bad97095871, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=31160, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@2fee81b8, vmName=test_affinity_2, cpuType=Conroe}], log id: 54bbf17 >2014-10-05 14:30:29,500 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:30:29,500 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-15) [18ec8949] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:29,500 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-6) [73de90ad] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:29,524 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-15) [18ec8949] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:30:29,531 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-6) [73de90ad] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:30:29,574 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-6) [73de90ad] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:29,581 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-15) [18ec8949] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:29,628 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:30:29,648 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-12) [73de90ad] Started HA reservation scoring method >2014-10-05 14:30:29,680 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: ff5e8a3 >2014-10-05 14:30:29,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:30:29,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 15d0cf67 >2014-10-05 14:30:29,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] FINISH, MigrateBrokerVDSCommand, log id: 15d0cf67 >2014-10-05 14:30:29,737 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [73de90ad] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: ff5e8a3 >2014-10-05 14:30:29,749 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [73de90ad] Correlation ID: 73de90ad, Job ID: 2cd4bb96-0eed-44d3-bc44-c48a32dad0b2, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:30:29,783 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:30:29,799 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-12) [18ec8949] Started HA reservation scoring method >2014-10-05 14:30:29,831 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 624df956 >2014-10-05 14:30:29,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:30:29,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3b5f50b1 >2014-10-05 14:30:29,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] FINISH, MigrateBrokerVDSCommand, log id: 3b5f50b1 >2014-10-05 14:30:29,896 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [18ec8949] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 624df956 >2014-10-05 14:30:29,907 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [18ec8949] Correlation ID: 18ec8949, Job ID: 771c7ec5-3ce7-4c81-8e16-c23459379d31, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:30:31,355 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:30:31,356 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:30:34,495 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae status = PoweringUp on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:30:34,497 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 status = PoweringUp on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:30:35,767 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) [687e4f13] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 5f9d1141 >2014-10-05 14:30:35,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) [687e4f13] FINISH, DestroyVDSCommand, log id: 5f9d1141 >2014-10-05 14:30:35,837 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) [687e4f13] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 2cdd207d >2014-10-05 14:30:35,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) [687e4f13] FINISH, DestroyVDSCommand, log id: 2cdd207d >2014-10-05 14:30:35,906 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [687e4f13] Handing over VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:30:35,906 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [687e4f13] VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:30:35,908 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [687e4f13] Handing over VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:30:35,908 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [687e4f13] VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:30:37,612 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingTo --> PoweringUp >2014-10-05 14:30:37,612 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingTo --> PoweringUp >2014-10-05 14:30:37,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae, efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 3d68b7f5 >2014-10-05 14:30:37,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9device_ee73fb22-9a76-44d7-aeaa-9ce0433e72ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ee73fb22-9a76-44d7-aeaa-9ce0433e72ca, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1dee2722-7136-47bd-b616-430685d94df9, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13aceb=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=947b595f-fd1a-4a9d-906e-1b715c13aceb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=194f2ed6-2427-4f3c-adb8-e41997d3c470, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=2da323f8-1e1e-49e6-b066-6bad97095871, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5901, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=15125, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@d9d075d, vmName=test_affinity_2, cpuType=Conroe}, {displaySecurePort=5904, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5903, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=15264, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@404e71a6, vmName=test_affinity_1, cpuType=Conroe}], log id: 3d68b7f5 >2014-10-05 14:30:51,942 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-43) [781081b9] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:51,943 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-42) [3b4d644] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:51,949 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-43) [781081b9] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:30:51,950 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-43) [781081b9] CanDoAction of action MigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IS_BEING_MIGRATED,$VmName test_affinity_2 >2014-10-05 14:30:51,950 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-43) [781081b9] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:51,952 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [3b4d644] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:30:51,952 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [3b4d644] CanDoAction of action MigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IS_BEING_MIGRATED,$VmName test_affinity_1 >2014-10-05 14:30:51,952 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-42) [3b4d644] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:53,652 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:30:53,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-59) Correlation ID: 18ec8949, Job ID: 771c7ec5-3ce7-4c81-8e16-c23459379d31, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 23 sec). >2014-10-05 14:30:53,670 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-59) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:30:56,741 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:30:56,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-67) Correlation ID: 73de90ad, Job ID: 2cd4bb96-0eed-44d3-bc44-c48a32dad0b2, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 27 sec). >2014-10-05 14:30:56,770 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-67) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:30:59,176 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:30:59,177 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-10) [5542813b] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:59,177 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-19) [1327438] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:59,182 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-19) [1327438] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:30:59,182 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-10) [5542813b] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:30:59,219 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-19) [1327438] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:30:59,238 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-10) [5542813b] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:30:59,272 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:30:59,294 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-8) [5542813b] Started HA reservation scoring method >2014-10-05 14:30:59,321 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 56dc501f >2014-10-05 14:30:59,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstHost=10.35.97.36:54321, method=online >2014-10-05 14:30:59,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 67a8492e >2014-10-05 14:30:59,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] FINISH, MigrateBrokerVDSCommand, log id: 67a8492e >2014-10-05 14:30:59,384 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5542813b] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 56dc501f >2014-10-05 14:30:59,392 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [5542813b] Correlation ID: 5542813b, Job ID: 651c300a-0165-4ee7-9fa9-0f6531d4b61e, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_2, Destination: hosted_engine_1, User: admin). >2014-10-05 14:30:59,417 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:30:59,428 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-8) [1327438] Started HA reservation scoring method >2014-10-05 14:30:59,441 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 537a54c >2014-10-05 14:30:59,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstHost=puma16.scl.lab.tlv.redhat.com:54321, method=online >2014-10-05 14:30:59,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1001468d >2014-10-05 14:30:59,498 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] FINISH, MigrateBrokerVDSCommand, log id: 1001468d >2014-10-05 14:30:59,507 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1327438] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 537a54c >2014-10-05 14:30:59,514 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [1327438] Correlation ID: 1327438, Job ID: b8c706dc-fbf9-4a13-ac50-95bfc07874a5, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_2, Destination: puma16.scl.lab.tlv.redhat.com, User: admin). >2014-10-05 14:31:00,350 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:31:02,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-84) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 2e332570 >2014-10-05 14:31:03,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, DestroyVDSCommand, log id: 2e332570 >2014-10-05 14:31:03,018 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingFrom --> Up >2014-10-05 14:31:03,018 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) Adding VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae to re-run list >2014-10-05 14:31:03,024 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) Handing over VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 to Host 25466fb3-6dfd-4f53-82ce-c622f4ab7726. Setting VM to status MigratingTo >2014-10-05 14:31:03,024 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS hosted_engine_2 >2014-10-05 14:31:03,053 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) Rerun vm f2dcdf0d-59ef-467e-a803-ac0002baa9ae. Called from vds hosted_engine_2 >2014-10-05 14:31:03,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, MigrateStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 3eca9fb1 >2014-10-05 14:31:03,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Failed in MigrateStatusVDS method >2014-10-05 14:31:03,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-05 14:31:03,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) HostName = hosted_engine_2 >2014-10-05 14:31:03,091 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Command MigrateStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-05 14:31:03,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, MigrateStatusVDSCommand, log id: 3eca9fb1 >2014-10-05 14:31:03,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) Correlation ID: 1327438, Job ID: b8c706dc-fbf9-4a13-ac50-95bfc07874a5, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: test_affinity_1, Source: hosted_engine_2, Destination: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:31:03,154 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-21) Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:31:03,174 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 21f3387 >2014-10-05 14:31:03,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-21) VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstHost=10.35.97.36:54321, method=online >2014-10-05 14:31:03,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 54f4ebd1 >2014-10-05 14:31:03,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, MigrateBrokerVDSCommand, log id: 54f4ebd1 >2014-10-05 14:31:03,237 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 21f3387 >2014-10-05 14:31:03,245 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) Correlation ID: 1327438, Job ID: b8c706dc-fbf9-4a13-ac50-95bfc07874a5, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, User: admin). >2014-10-05 14:31:03,446 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:31:03,447 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingTo --> Up >2014-10-05 14:31:03,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 55f368f0 >2014-10-05 14:31:03,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9device_ee73fb22-9a76-44d7-aeaa-9ce0433e72ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ee73fb22-9a76-44d7-aeaa-9ce0433e72ca, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1dee2722-7136-47bd-b616-430685d94df9, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13aceb=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=947b595f-fd1a-4a9d-906e-1b715c13aceb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=194f2ed6-2427-4f3c-adb8-e41997d3c470, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=2da323f8-1e1e-49e6-b066-6bad97095871, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=1171, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@5b97677d, vmName=test_affinity_2, cpuType=Conroe}], log id: 55f368f0 >2014-10-05 14:31:03,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: 5542813b, Job ID: 651c300a-0165-4ee7-9fa9-0f6531d4b61e, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 4 sec). >2014-10-05 14:31:03,621 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-81) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:31:06,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-96) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 5d43c301 >2014-10-05 14:31:06,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, DestroyVDSCommand, log id: 5d43c301 >2014-10-05 14:31:06,259 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Handing over VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae to Host 25466fb3-6dfd-4f53-82ce-c622f4ab7726. Setting VM to status MigratingTo >2014-10-05 14:31:06,259 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS hosted_engine_2 >2014-10-05 14:31:06,691 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingTo --> Up >2014-10-05 14:31:06,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 1671c62d >2014-10-05 14:31:06,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5902, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=1344, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@26da0055, vmName=test_affinity_1, cpuType=Conroe}], log id: 1671c62d >2014-10-05 14:31:06,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: 1327438, Job ID: b8c706dc-fbf9-4a13-ac50-95bfc07874a5, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 3 sec). >2014-10-05 14:31:06,859 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-91) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:31:06,862 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) START, FailedToRunVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 53eb89ab >2014-10-05 14:31:06,862 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) FINISH, FailedToRunVmVDSCommand, log id: 53eb89ab >2014-10-05 14:31:11,444 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:31:11,445 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [5349517a] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:31:11,445 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-8) [5c9561d2] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:31:11,452 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-17) [5349517a] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:31:11,453 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-8) [5c9561d2] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:31:11,474 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [5349517a] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:31:11,484 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-8) [5c9561d2] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:31:11,511 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:31:11,522 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] Started HA reservation scoring method >2014-10-05 14:31:11,534 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 5d76f2b0 >2014-10-05 14:31:11,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:31:11,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: a3229ed >2014-10-05 14:31:11,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] FINISH, MigrateBrokerVDSCommand, log id: a3229ed >2014-10-05 14:31:11,591 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5d76f2b0 >2014-10-05 14:31:11,598 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [5c9561d2] Correlation ID: 5c9561d2, Job ID: 8a49ed41-d2d5-4f07-ac93-c069fa24c4e4, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:31:11,619 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:31:11,631 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-27) [5349517a] Started HA reservation scoring method >2014-10-05 14:31:11,657 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 4e6edca6 >2014-10-05 14:31:11,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:31:11,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 68776327 >2014-10-05 14:31:11,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] FINISH, MigrateBrokerVDSCommand, log id: 68776327 >2014-10-05 14:31:11,731 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5349517a] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4e6edca6 >2014-10-05 14:31:11,738 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [5349517a] Correlation ID: 5349517a, Job ID: 46177130-7e92-448e-94e8-9b0fa035a209, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:31:12,383 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:31:12,384 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:31:15,534 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:31:15,536 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:31:16,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-20) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 6c6a27e4 >2014-10-05 14:31:16,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, DestroyVDSCommand, log id: 6c6a27e4 >2014-10-05 14:31:16,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-20) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: d75f38e >2014-10-05 14:31:16,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, DestroyVDSCommand, log id: d75f38e >2014-10-05 14:31:16,353 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Handing over VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:31:16,353 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:31:16,354 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Handing over VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:31:16,354 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:31:18,731 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingTo --> Up >2014-10-05 14:31:18,732 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingTo --> Up >2014-10-05 14:31:18,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae, efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 2fcff5b6 >2014-10-05 14:31:18,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9device_ee73fb22-9a76-44d7-aeaa-9ce0433e72ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ee73fb22-9a76-44d7-aeaa-9ce0433e72ca, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871device_1dee2722-7136-47bd-b616-430685d94df9=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1dee2722-7136-47bd-b616-430685d94df9, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13aceb=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=947b595f-fd1a-4a9d-906e-1b715c13aceb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=194f2ed6-2427-4f3c-adb8-e41997d3c470, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_947b595f-fd1a-4a9d-906e-1b715c13acebdevice_194f2ed6-2427-4f3c-adb8-e41997d3c470device_2da323f8-1e1e-49e6-b066-6bad97095871=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=2da323f8-1e1e-49e6-b066-6bad97095871, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5901, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=17158, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@7e0c983f, vmName=test_affinity_2, cpuType=Conroe}, {displaySecurePort=5904, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=dbdf1183-48d1-4a66-bcb0-3aedbbe5b517, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fc=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=98acf063-b36d-454e-9120-4eab45dc26fc, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cbdevice_98acf063-b36d-454e-9120-4eab45dc26fcdevice_dbdf1183-48d1-4a66-bcb0-3aedbbe5b517device_857c39a4-dbbe-4d09-9b6e-c06a12078a12=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=857c39a4-dbbe-4d09-9b6e-c06a12078a12, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a9195ad2-f4dd-4ede-8021-41da6aa45407, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_a9195ad2-f4dd-4ede-8021-41da6aa45407device_e7c40f10-85fd-4dd0-bbeb-1f5cbecd7b63device_25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=25cdf8b3-8e3a-4cd5-96e7-6c07483e99cb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5903, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=17296, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6cdf90bf, vmName=test_affinity_1, cpuType=Conroe}], log id: 2fcff5b6 >2014-10-05 14:31:19,012 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: 5349517a, Job ID: 46177130-7e92-448e-94e8-9b0fa035a209, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 7 sec). >2014-10-05 14:31:19,025 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-33) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:31:19,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: 5c9561d2, Job ID: 8a49ed41-d2d5-4f07-ac93-c069fa24c4e4, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 7 sec). >2014-10-05 14:31:19,045 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-33) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:31:58,239 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:31:58,239 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-12) [2eab1ba4] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:31:58,239 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-11) [63a3c3eb] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:31:58,245 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-12) [2eab1ba4] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:31:58,245 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-11) [63a3c3eb] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:31:58,295 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:31:58,297 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] Entered (VM test_affinity_2). >2014-10-05 14:31:58,297 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] Sending shutdown command for VM test_affinity_2. >2014-10-05 14:31:58,300 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 63bf2cb7 >2014-10-05 14:31:58,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 54e26552 >2014-10-05 14:31:58,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] FINISH, DestroyVDSCommand, log id: 54e26552 >2014-10-05 14:31:58,361 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 63bf2cb7 >2014-10-05 14:31:58,370 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [2eab1ba4] Correlation ID: 2eab1ba4, Job ID: 1707c924-73be-4ef9-9a25-91668589afb4, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_2). >2014-10-05 14:31:58,395 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:31:58,397 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] Entered (VM test_affinity_1). >2014-10-05 14:31:58,397 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] Sending shutdown command for VM test_affinity_1. >2014-10-05 14:31:58,398 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 47726999 >2014-10-05 14:31:58,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 4edc122f >2014-10-05 14:31:58,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] FINISH, DestroyVDSCommand, log id: 4edc122f >2014-10-05 14:31:58,453 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 47726999 >2014-10-05 14:31:58,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [63a3c3eb] Correlation ID: 63a3c3eb, Job ID: bf0152e1-6408-4470-8c02-7ba242e4ba78, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_2). >2014-10-05 14:32:04,141 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-50) [42667326] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:32:04,141 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-35) [5411e5d8] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:32:04,145 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-35) [5411e5d8] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:32:04,149 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-50) [42667326] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:32:04,179 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [42667326] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:32:04,180 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [42667326] Entered (VM test_affinity_2). >2014-10-05 14:32:04,180 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [42667326] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 14:32:04,188 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:32:04,191 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 29aaef82 >2014-10-05 14:32:04,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 42da2fed >2014-10-05 14:32:04,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] FINISH, DestroyVDSCommand, log id: 42da2fed >2014-10-05 14:32:04,728 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] FINISH, DestroyVmVDSCommand, return: Down, log id: 29aaef82 >2014-10-05 14:32:04,728 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-43) [26a1fc42] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:32:04,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [1cd6649a] Correlation ID: 1cd6649a, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:32:04,783 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [5411e5d8] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:32:04,785 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [5411e5d8] Entered (VM test_affinity_1). >2014-10-05 14:32:04,785 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-21) [5411e5d8] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 14:32:04,789 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-21) [75de40a1] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:32:04,792 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [75de40a1] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 192b9d3c >2014-10-05 14:32:04,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [75de40a1] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 768a07f3 >2014-10-05 14:32:05,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [75de40a1] FINISH, DestroyVDSCommand, log id: 768a07f3 >2014-10-05 14:32:05,266 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-26) [1a79b2b3] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:32:05,267 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [75de40a1] FINISH, DestroyVmVDSCommand, return: Down, log id: 192b9d3c >2014-10-05 14:32:05,294 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [75de40a1] Correlation ID: 75de40a1, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:32:24,545 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-2) [32e4b2b4] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:32:24,579 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-2) [32e4b2b4] Running command: UpdateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:32:24,619 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [32e4b2b4] Correlation ID: 32e4b2b4, Job ID: 652ed241-fd3d-4823-8aec-d05bce837ddf, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 configuration was updated by admin. >2014-10-05 14:32:24,625 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-2) [32e4b2b4] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:32:34,359 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [579525ca] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_2 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:32:34,389 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [579525ca] Running command: UpdateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:32:34,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [579525ca] Correlation ID: 579525ca, Job ID: 2fa9cb62-e76c-4d35-a9ca-1a76b774f597, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 configuration was updated by admin. >2014-10-05 14:32:34,432 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [579525ca] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_2 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:32:39,416 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-38) [4f92d218] Start running CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:32:39,417 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-38) [4f92d218] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:32:39,424 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-40) [5be80750] Start running CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:32:39,426 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-40) [5be80750] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:32:39,440 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5be80750] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 2bef47a8 >2014-10-05 14:32:39,440 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5be80750] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2bef47a8 >2014-10-05 14:32:39,443 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4f92d218] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 17d598 >2014-10-05 14:32:39,443 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4f92d218] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 17d598 >2014-10-05 14:32:39,462 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-38) [4f92d218] Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:32:39,463 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-40) [5be80750] Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:32:39,499 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:32:39,528 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 34991ae3 >2014-10-05 14:32:39,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 260e5f35 >2014-10-05 14:32:40,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901device_9260450f-bf66-49b9-9237-00b47cacf57c=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9260450f-bf66-49b9-9237-00b47cacf57c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=0238a209-b471-49d2-b3cb-a467395eb6d5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=33b2cee6-8523-4787-b2b1-ec719a8f0b70, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=f5a2f8f1-6720-4295-ab74-a468db16f901, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aa=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3d10597b-13c5-43e3-bdff-1b645f1295aa, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-05 14:32:40,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] FINISH, CreateVDSCommand, log id: 260e5f35 >2014-10-05 14:32:40,381 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 34991ae3 >2014-10-05 14:32:40,381 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [4f92d218] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:32:40,388 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [4f92d218] Correlation ID: 4f92d218, Job ID: 14378870-6a5a-48ad-8c10-e33e86713225, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 14:32:40,414 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:32:40,431 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-21) [5be80750] Candidate host puma16.scl.lab.tlv.redhat.com (27d8f2a3-df14-411c-9163-dead0f6754e4) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 5be80750) >2014-10-05 14:32:40,431 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-21) [5be80750] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 5be80750) >2014-10-05 14:32:40,450 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 27618c3e >2014-10-05 14:32:40,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 479e6036 >2014-10-05 14:32:41,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6device_8b1fd760-ffd1-49fa-bd21-c8cfb05d1376=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=8b1fd760-ffd1-49fa-bd21-c8cfb05d1376, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82e=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ec65ad95-7de8-4104-a463-ec29a84fa82e, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b0000aa2-4754-41e5-b06e-f6e21b829224, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ca3e15ce-36ba-4320-96f4-50db4e60cfd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7fcdaa0b-81de-44d8-8ecd-3d39187b4304, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-05 14:32:41,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] FINISH, CreateVDSCommand, log id: 479e6036 >2014-10-05 14:32:41,276 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 27618c3e >2014-10-05 14:32:41,276 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [5be80750] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:32:41,291 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [5be80750] Correlation ID: 5be80750, Job ID: b6c4c181-7b8f-4361-8f4f-02bbe0017c02, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_1). >2014-10-05 14:32:44,439 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:32:44,441 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:32:44,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-55) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae, efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 5fb74af7 >2014-10-05 14:32:44,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-55) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6device_8b1fd760-ffd1-49fa-bd21-c8cfb05d1376=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=8b1fd760-ffd1-49fa-bd21-c8cfb05d1376, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82e=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ec65ad95-7de8-4104-a463-ec29a84fa82e, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b0000aa2-4754-41e5-b06e-f6e21b829224, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ca3e15ce-36ba-4320-96f4-50db4e60cfd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7fcdaa0b-81de-44d8-8ecd-3d39187b4304, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=5353, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@7a9acf38, vmName=test_affinity_2, cpuType=Conroe}, {displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901device_9260450f-bf66-49b9-9237-00b47cacf57c=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9260450f-bf66-49b9-9237-00b47cacf57c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=0238a209-b471-49d2-b3cb-a467395eb6d5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=33b2cee6-8523-4787-b2b1-ec719a8f0b70, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aa=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3d10597b-13c5-43e3-bdff-1b645f1295aa, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=f5a2f8f1-6720-4295-ab74-a468db16f901, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=5211, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@499aa46a, vmName=test_affinity_1, cpuType=Conroe}], log id: 5fb74af7 >2014-10-05 14:33:42,814 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:33:42,814 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:33:42,826 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: 4f92d218, Job ID: 14378870-6a5a-48ad-8c10-e33e86713225, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 started on Host hosted_engine_1 >2014-10-05 14:33:42,841 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: 5be80750, Job ID: b6c4c181-7b8f-4361-8f4f-02bbe0017c02, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_1 >2014-10-05 14:34:27,149 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-22) [5325bb89] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:34:27,150 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [523b4a04] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:34:27,154 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-17) [523b4a04] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:34:27,155 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-22) [5325bb89] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:34:27,175 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-22) [5325bb89] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:34:27,186 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-17) [523b4a04] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:34:27,215 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:34:27,247 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-8) [5325bb89] Started HA reservation scoring method >2014-10-05 14:34:27,269 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 6b18afd6 >2014-10-05 14:34:27,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:34:27,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 2b1b5552 >2014-10-05 14:34:27,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] FINISH, MigrateBrokerVDSCommand, log id: 2b1b5552 >2014-10-05 14:34:27,333 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [5325bb89] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 6b18afd6 >2014-10-05 14:34:27,341 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [5325bb89] Correlation ID: 5325bb89, Job ID: ed1c886c-9615-409b-b5ef-220daa76009d, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:34:27,364 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:34:29,309 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:32,364 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-36) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:35,418 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:37,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-8) [523b4a04] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 523b4a04) >2014-10-05 14:34:37,390 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 7136929c >2014-10-05 14:34:37,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=puma16.scl.lab.tlv.redhat.com:54321, method=online >2014-10-05 14:34:37,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 560c39f4 >2014-10-05 14:34:37,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] FINISH, MigrateBrokerVDSCommand, log id: 560c39f4 >2014-10-05 14:34:37,449 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-8) [523b4a04] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 7136929c >2014-10-05 14:34:37,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [523b4a04] Correlation ID: 523b4a04, Job ID: 88ede71b-48ea-4782-b749-7b537f494a00, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_1, Destination: puma16.scl.lab.tlv.redhat.com, User: admin). >2014-10-05 14:34:38,113 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) [c0c7d94] RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds puma16.scl.lab.tlv.redhat.com ignoring it in the refresh until migration is done >2014-10-05 14:34:38,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 3cb36003 >2014-10-05 14:34:38,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6device_8b1fd760-ffd1-49fa-bd21-c8cfb05d1376=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=8b1fd760-ffd1-49fa-bd21-c8cfb05d1376, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82e=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ec65ad95-7de8-4104-a463-ec29a84fa82e, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b0000aa2-4754-41e5-b06e-f6e21b829224, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ca3e15ce-36ba-4320-96f4-50db4e60cfd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7fcdaa0b-81de-44d8-8ecd-3d39187b4304, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5901, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=24189, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@431c14ab, vmName=test_affinity_2, cpuType=Conroe}], log id: 3cb36003 >2014-10-05 14:34:38,635 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-64) Correlation ID: 5325bb89, Job ID: ed1c886c-9615-409b-b5ef-220daa76009d, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 11 sec). >2014-10-05 14:34:38,640 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-64) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:34:41,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: a1154a6 >2014-10-05 14:34:41,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, DestroyVDSCommand, log id: a1154a6 >2014-10-05 14:34:41,154 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingFrom --> Up >2014-10-05 14:34:41,154 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) Adding VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae to re-run list >2014-10-05 14:34:41,163 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 status = Down on vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:34:41,216 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) Rerun vm f2dcdf0d-59ef-467e-a803-ac0002baa9ae. Called from vds hosted_engine_1 >2014-10-05 14:34:41,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) START, MigrateStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 735e26cc >2014-10-05 14:34:41,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) Failed in MigrateStatusVDS method >2014-10-05 14:34:41,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-05 14:34:41,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) HostName = hosted_engine_1 >2014-10-05 14:34:41,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) Command MigrateStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-05 14:34:41,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) FINISH, MigrateStatusVDSCommand, log id: 735e26cc >2014-10-05 14:34:41,285 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) Correlation ID: 523b4a04, Job ID: 88ede71b-48ea-4782-b749-7b537f494a00, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: test_affinity_1, Source: hosted_engine_1, Destination: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:34:41,331 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-19) Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:34:41,353 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-19) START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 5a37f65b >2014-10-05 14:34:41,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-19) VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:34:41,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-19) START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 6272a644 >2014-10-05 14:34:41,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-19) FINISH, MigrateBrokerVDSCommand, log id: 6272a644 >2014-10-05 14:34:41,411 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-19) FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5a37f65b >2014-10-05 14:34:41,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) Correlation ID: 523b4a04, Job ID: 88ede71b-48ea-4782-b749-7b537f494a00, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin). >2014-10-05 14:34:41,827 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:44,913 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:47,968 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-77) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:51,027 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:34:53,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-12) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 3a63e17e >2014-10-05 14:34:53,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, DestroyVDSCommand, log id: 3a63e17e >2014-10-05 14:34:53,658 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) Handing over VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae to Host a6249d4e-b23d-4a14-9f56-a0761d824721. Setting VM to status MigratingTo >2014-10-05 14:34:53,658 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS hosted_engine_1 >2014-10-05 14:34:54,092 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingTo --> Up >2014-10-05 14:34:54,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-3) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 102c9906 >2014-10-05 14:34:54,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-3) FINISH, FullListVdsCommand, return: [{displaySecurePort=5904, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901device_9260450f-bf66-49b9-9237-00b47cacf57c=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9260450f-bf66-49b9-9237-00b47cacf57c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=0238a209-b471-49d2-b3cb-a467395eb6d5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=33b2cee6-8523-4787-b2b1-ec719a8f0b70, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=f5a2f8f1-6720-4295-ab74-a468db16f901, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aa=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3d10597b-13c5-43e3-bdff-1b645f1295aa, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5903, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=25099, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@21cc0fc9, vmName=test_affinity_1, cpuType=Conroe}], log id: 102c9906 >2014-10-05 14:34:54,248 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: 523b4a04, Job ID: 88ede71b-48ea-4782-b749-7b537f494a00, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 12 sec). >2014-10-05 14:34:54,254 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-18) START, FailedToRunVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 2721b05c >2014-10-05 14:34:54,255 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-18) FINISH, FailedToRunVmVDSCommand, log id: 2721b05c >2014-10-05 14:34:54,255 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-3) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:35:13,060 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:35:55,490 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:35:55,490 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-32) [49a27a9e] Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:35:55,494 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-23) [4a2040d6] Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:35:55,496 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-32) [49a27a9e] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:35:55,504 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-23) [4a2040d6] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:35:55,529 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-23) [4a2040d6] Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2014-10-05 14:35:55,530 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-32) [49a27a9e] Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2014-10-05 14:35:55,566 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:35:55,592 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] Started HA reservation scoring method >2014-10-05 14:35:55,606 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3d1be2cf >2014-10-05 14:35:55,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstHost=10.35.97.36:54321, method=online >2014-10-05 14:35:55,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 62bfbed2 >2014-10-05 14:35:55,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] FINISH, MigrateBrokerVDSCommand, log id: 62bfbed2 >2014-10-05 14:35:55,682 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 3d1be2cf >2014-10-05 14:35:55,691 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [49a27a9e] Correlation ID: 49a27a9e, Job ID: 723ea5ba-2933-4ed8-bb70-f23f058be528, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, User: admin). >2014-10-05 14:35:55,718 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:35:55,839 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:35:58,933 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:02,015 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:05,104 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:05,724 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] Candidate host hosted_engine_1 (25466fb3-6dfd-4f53-82ce-c622f4ab7726) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 4a2040d6) >2014-10-05 14:36:05,751 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 6db593d6 >2014-10-05 14:36:05,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstHost=puma16.scl.lab.tlv.redhat.com:54321, method=online >2014-10-05 14:36:05,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3757bd49 >2014-10-05 14:36:05,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] FINISH, MigrateBrokerVDSCommand, log id: 3757bd49 >2014-10-05 14:36:05,843 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 6db593d6 >2014-10-05 14:36:05,852 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4a2040d6] Correlation ID: 4a2040d6, Job ID: 9fd589c7-f9ea-41a8-ac37-b08b417acdd1, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_2, Destination: puma16.scl.lab.tlv.redhat.com, User: admin). >2014-10-05 14:36:08,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-1) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 1a55a417 >2014-10-05 14:36:08,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-1) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901device_9260450f-bf66-49b9-9237-00b47cacf57c=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9260450f-bf66-49b9-9237-00b47cacf57c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=0238a209-b471-49d2-b3cb-a467395eb6d5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=33b2cee6-8523-4787-b2b1-ec719a8f0b70, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aa=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3d10597b-13c5-43e3-bdff-1b645f1295aa, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=f5a2f8f1-6720-4295-ab74-a468db16f901, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5900, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=15000, display=qxl, pid=12287, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@67d6715e, vmName=test_affinity_1, cpuType=Conroe}], log id: 1a55a417 >2014-10-05 14:36:08,534 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) Correlation ID: 49a27a9e, Job ID: 723ea5ba-2933-4ed8-bb70-f23f058be528, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 12 sec). >2014-10-05 14:36:08,541 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-1) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:36:09,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-3) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 565b53e7 >2014-10-05 14:36:09,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, DestroyVDSCommand, log id: 565b53e7 >2014-10-05 14:36:09,804 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae status = Down on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:36:09,805 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingFrom --> Up >2014-10-05 14:36:09,805 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) Adding VM efe2c68c-1a43-4965-8419-884d13f0dda8 to re-run list >2014-10-05 14:36:09,819 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) Rerun vm efe2c68c-1a43-4965-8419-884d13f0dda8. Called from vds hosted_engine_2 >2014-10-05 14:36:09,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) START, MigrateStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 36fc0187 >2014-10-05 14:36:09,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) Failed in MigrateStatusVDS method >2014-10-05 14:36:09,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-05 14:36:09,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) HostName = hosted_engine_2 >2014-10-05 14:36:09,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) Command MigrateStatusVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-05 14:36:09,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) FINISH, MigrateStatusVDSCommand, log id: 36fc0187 >2014-10-05 14:36:09,896 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) Correlation ID: 4a2040d6, Job ID: 9fd589c7-f9ea-41a8-ac37-b08b417acdd1, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: test_affinity_2, Source: hosted_engine_2, Destination: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:36:09,934 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) Running command: MigrateVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:36:09,957 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-42) START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 63b9d4cf >2014-10-05 14:36:09,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstHost=10.35.97.36:54321, method=online >2014-10-05 14:36:09,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1c8ee0a5 >2014-10-05 14:36:10,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) FINISH, MigrateBrokerVDSCommand, log id: 1c8ee0a5 >2014-10-05 14:36:10,032 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-42) FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 63b9d4cf >2014-10-05 14:36:10,037 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) Correlation ID: 4a2040d6, Job ID: 9fd589c7-f9ea-41a8-ac37-b08b417acdd1, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_2, Source: hosted_engine_2, Destination: hosted_engine_1, User: admin). >2014-10-05 14:36:11,625 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:14,695 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:17,767 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-21) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:20,832 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:36:22,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 25fa520a >2014-10-05 14:36:22,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) [63935c66] FINISH, DestroyVDSCommand, log id: 25fa520a >2014-10-05 14:36:22,404 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) [63935c66] Handing over VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 to Host 25466fb3-6dfd-4f53-82ce-c622f4ab7726. Setting VM to status MigratingTo >2014-10-05 14:36:22,404 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) [63935c66] VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS hosted_engine_2 >2014-10-05 14:36:24,018 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-42) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from MigratingTo --> Up >2014-10-05 14:36:24,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-42) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 10d9aea2 >2014-10-05 14:36:24,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-42) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6device_8b1fd760-ffd1-49fa-bd21-c8cfb05d1376=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=8b1fd760-ffd1-49fa-bd21-c8cfb05d1376, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82e=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ec65ad95-7de8-4104-a463-ec29a84fa82e, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b0000aa2-4754-41e5-b06e-f6e21b829224, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ca3e15ce-36ba-4320-96f4-50db4e60cfd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7fcdaa0b-81de-44d8-8ecd-3d39187b4304, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5902, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=15000, display=qxl, pid=13153, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@43581652, vmName=test_affinity_2, cpuType=Conroe}], log id: 10d9aea2 >2014-10-05 14:36:24,228 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) Correlation ID: 4a2040d6, Job ID: 9fd589c7-f9ea-41a8-ac37-b08b417acdd1, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 14 sec). >2014-10-05 14:36:24,236 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-37) START, FailedToRunVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 685a61bb >2014-10-05 14:36:24,237 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) START, SetVdsStatusVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, status=Error, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 27c5ab0 >2014-10-05 14:36:24,242 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-42) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:36:24,251 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) FINISH, SetVdsStatusVDSCommand, log id: 27c5ab0 >2014-10-05 14:36:24,261 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com will be switched to Error status for 30 minutes because it failed to run a VM. >2014-10-05 14:36:24,263 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-37) Vds puma16.scl.lab.tlv.redhat.com moved to Error mode after 3 attempts. Time: 10/5/14 2:36 PM >2014-10-05 14:36:24,263 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-37) FINISH, FailedToRunVmVDSCommand, log id: 685a61bb >2014-10-05 14:36:48,778 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-5) [4930dd97] Lock Acquired to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:36:48,811 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:36:48,811 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Before acquiring lock in order to prevent monitoring for host puma16.scl.lab.tlv.redhat.com from data-center Default >2014-10-05 14:36:48,812 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Lock acquired, from now a monitoring of host will be skipped for host puma16.scl.lab.tlv.redhat.com from data-center Default >2014-10-05 14:36:48,818 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] START, SetVdsStatusVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2cd6dde8 >2014-10-05 14:36:48,830 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] FINISH, SetVdsStatusVDSCommand, log id: 2cd6dde8 >2014-10-05 14:36:48,857 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Activate finished. Lock released. Monitoring can run now for host puma16.scl.lab.tlv.redhat.com from data-center Default >2014-10-05 14:36:48,864 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Correlation ID: 4930dd97, Job ID: 0e5dd88d-ef86-4e0b-948f-bcd2d1ae24cd, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com was activated by admin. >2014-10-05 14:36:48,873 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4930dd97] Lock freed to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:36:49,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [42048907] START, GetHardwareInfoVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vds=Host[puma16.scl.lab.tlv.redhat.com,27d8f2a3-df14-411c-9163-dead0f6754e4]), log id: 348fc865 >2014-10-05 14:36:50,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [42048907] FINISH, GetHardwareInfoVDSCommand, log id: 348fc865 >2014-10-05 14:36:50,049 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-6) [19c84442] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:36:50,059 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) [19c84442] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:36:50,080 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-6) [3548806f] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:36:50,086 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:36:50,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] START, ConnectStorageServerVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7c8bebb5 >2014-10-05 14:36:50,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 7c8bebb5 >2014-10-05 14:36:50,185 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] Host puma16.scl.lab.tlv.redhat.com storage connection was succeeded >2014-10-05 14:36:50,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-14) START, ConnectStoragePoolVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 3, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 6d570fe3 >2014-10-05 14:36:50,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-14) FINISH, ConnectStoragePoolVDSCommand, log id: 6d570fe3 >2014-10-05 14:36:50,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] START, SetMOMPolicyParametersVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 6d4b6010 >2014-10-05 14:36:51,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-6) [3aba0b79] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6d4b6010 >2014-10-05 14:36:51,069 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) [3aba0b79] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:36:51,085 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [50465574] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:36:56,998 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:36:57,000 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 4392521f >2014-10-05 14:36:57,012 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] FINISH, SetVdsStatusVDSCommand, log id: 4392521f >2014-10-05 14:36:57,082 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:36:57,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 4960d47f >2014-10-05 14:36:57,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-50) [2ef3863a] FINISH, SetHaMaintenanceModeVDSCommand, log id: 4960d47f >2014-10-05 14:36:57,152 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:36:57,190 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:36:57,204 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-50) [165acbc1] Started HA reservation scoring method >2014-10-05 14:36:57,221 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: b29b165 >2014-10-05 14:36:57,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] VdsBroker::migrate::Entered (vm_guid=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:36:57,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1caf84f8 >2014-10-05 14:36:57,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] FINISH, MigrateBrokerVDSCommand, log id: 1caf84f8 >2014-10-05 14:36:57,296 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [165acbc1] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: b29b165 >2014-10-05 14:36:57,325 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:36:57,344 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory >2014-10-05 14:36:57,366 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:37:00,406 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:03,606 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) [22468763] RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:06,691 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-10) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:07,370 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 19fd6cc2) >2014-10-05 14:37:07,393 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 449767c2 >2014-10-05 14:37:07,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=puma16.scl.lab.tlv.redhat.com:54321, method=online >2014-10-05 14:37:07,394 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=27d8f2a3-df14-411c-9163-dead0f6754e4, dstHost=puma16.scl.lab.tlv.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 4953bd75 >2014-10-05 14:37:07,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] FINISH, MigrateBrokerVDSCommand, log id: 4953bd75 >2014-10-05 14:37:07,470 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 449767c2 >2014-10-05 14:37:07,489 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [19fd6cc2] Correlation ID: 2ef3863a, Job ID: 12b5c794-53ad-4af9-87eb-7d00090e2840, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was switched to Maintenance mode by admin. >2014-10-05 14:37:09,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 361c5881 >2014-10-05 14:37:09,887 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6device_8b1fd760-ffd1-49fa-bd21-c8cfb05d1376=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=8b1fd760-ffd1-49fa-bd21-c8cfb05d1376, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82e=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ec65ad95-7de8-4104-a463-ec29a84fa82e, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b0000aa2-4754-41e5-b06e-f6e21b829224, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304device_ec65ad95-7de8-4104-a463-ec29a84fa82edevice_ca3e15ce-36ba-4320-96f4-50db4e60cfd6=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=ca3e15ce-36ba-4320-96f4-50db4e60cfd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b0000aa2-4754-41e5-b06e-f6e21b829224device_7fcdaa0b-81de-44d8-8ecd-3d39187b4304=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7fcdaa0b-81de-44d8-8ecd-3d39187b4304, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5901, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=15000, display=qxl, pid=30463, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@2412e87c, vmName=test_affinity_2, cpuType=Conroe}], log id: 361c5881 >2014-10-05 14:37:09,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-64) Correlation ID: 165acbc1, Job ID: 12b5c794-53ad-4af9-87eb-7d00090e2840, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_2, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 12 sec). >2014-10-05 14:37:09,941 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-64) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:37:10,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 2cb8da42 >2014-10-05 14:37:10,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, DestroyVDSCommand, log id: 2cb8da42 >2014-10-05 14:37:10,885 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from MigratingFrom --> Up >2014-10-05 14:37:10,885 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) Adding VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae to re-run list >2014-10-05 14:37:10,887 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) RefreshVmList vm id efe2c68c-1a43-4965-8419-884d13f0dda8 status = Down on vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:37:10,915 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) Rerun vm f2dcdf0d-59ef-467e-a803-ac0002baa9ae. Called from vds hosted_engine_1 >2014-10-05 14:37:10,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) START, MigrateStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 6f86893d >2014-10-05 14:37:10,945 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) Failed in MigrateStatusVDS method >2014-10-05 14:37:10,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-05 14:37:10,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) HostName = hosted_engine_1 >2014-10-05 14:37:10,946 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) Command MigrateStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-05 14:37:10,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) FINISH, MigrateStatusVDSCommand, log id: 6f86893d >2014-10-05 14:37:10,960 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) Correlation ID: 19fd6cc2, Job ID: 12b5c794-53ad-4af9-87eb-7d00090e2840, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: test_affinity_1, Source: hosted_engine_1, Destination: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:37:10,995 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-43) Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:37:11,015 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-43) START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 7aa48719 >2014-10-05 14:37:11,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-43) VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:37:11,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-43) START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3c405ba0 >2014-10-05 14:37:11,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-43) FINISH, MigrateBrokerVDSCommand, log id: 3c405ba0 >2014-10-05 14:37:11,083 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-43) FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 7aa48719 >2014-10-05 14:37:13,005 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:16,092 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-85) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:19,300 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:37:22,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 44443bae >2014-10-05 14:37:22,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5904, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901device_9260450f-bf66-49b9-9237-00b47cacf57c=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9260450f-bf66-49b9-9237-00b47cacf57c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=0238a209-b471-49d2-b3cb-a467395eb6d5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=33b2cee6-8523-4787-b2b1-ec719a8f0b70, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aadevice_33b2cee6-8523-4787-b2b1-ec719a8f0b70device_f5a2f8f1-6720-4295-ab74-a468db16f901=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=f5a2f8f1-6720-4295-ab74-a468db16f901, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_0238a209-b471-49d2-b3cb-a467395eb6d5device_3d10597b-13c5-43e3-bdff-1b645f1295aa=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3d10597b-13c5-43e3-bdff-1b645f1295aa, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5903, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=15000, display=qxl, pid=31040, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@34490875, vmName=test_affinity_1, cpuType=Conroe}], log id: 44443bae >2014-10-05 14:37:22,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: 19fd6cc2, Job ID: 12b5c794-53ad-4af9-87eb-7d00090e2840, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 11 sec). >2014-10-05 14:37:22,670 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-91) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:37:22,672 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, FailedToRunVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 289e836a >2014-10-05 14:37:22,673 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, FailedToRunVmVDSCommand, log id: 289e836a >2014-10-05 14:37:23,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-100) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 28d3d59b >2014-10-05 14:37:23,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, DestroyVDSCommand, log id: 28d3d59b >2014-10-05 14:37:23,685 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-100) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae status = Down on vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:37:26,827 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) [2f317f05] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 25466fb3-6dfd-4f53-82ce-c622f4ab7726 : hosted_engine_1 >2014-10-05 14:37:26,846 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-26) Clearing cache of pool: 00000002-0002-0002-0002-000000000366 for problematic entities of VDS: hosted_engine_1. >2014-10-05 14:37:26,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-5) [2f317f05] START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1), log id: 1e13efef >2014-10-05 14:37:30,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-5) [2f317f05] FINISH, DisconnectStoragePoolVDSCommand, log id: 1e13efef >2014-10-05 14:37:30,796 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-5) [654b299c] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:37:30,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-5) [654b299c] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1609785c >2014-10-05 14:37:31,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-5) [654b299c] FINISH, DisconnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 1609785c >2014-10-05 14:38:01,264 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-6) [5e4190a6] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:38:01,265 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-14) [227fb2a2] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:38:01,272 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-14) [227fb2a2] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:38:01,277 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-6) [5e4190a6] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:38:01,321 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:01,324 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] Entered (VM test_affinity_1). >2014-10-05 14:38:01,324 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] Sending shutdown command for VM test_affinity_1. >2014-10-05 14:38:01,326 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 76636db7 >2014-10-05 14:38:01,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 7282ff6a >2014-10-05 14:38:01,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] FINISH, DestroyVDSCommand, log id: 7282ff6a >2014-10-05 14:38:01,409 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 76636db7 >2014-10-05 14:38:01,424 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [5e4190a6] Correlation ID: 5e4190a6, Job ID: ef3e51a7-f802-4198-b2b0-d65d685f4090, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_2). >2014-10-05 14:38:01,465 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:38:01,469 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] Entered (VM test_affinity_2). >2014-10-05 14:38:01,469 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] Sending shutdown command for VM test_affinity_2. >2014-10-05 14:38:01,471 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 3d542cf2 >2014-10-05 14:38:01,476 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 4560247c >2014-10-05 14:38:01,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] FINISH, DestroyVDSCommand, log id: 4560247c >2014-10-05 14:38:01,542 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 3d542cf2 >2014-10-05 14:38:01,578 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [227fb2a2] Correlation ID: 227fb2a2, Job ID: 6c80f82c-8efe-480c-a521-755b9300abd1, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_2). >2014-10-05 14:38:03,632 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-35) [b31d4fc] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:38:03,633 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-50) [7495f221] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:38:03,637 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-35) [b31d4fc] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:38:03,638 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-50) [7495f221] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:38:03,675 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [b31d4fc] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:38:03,678 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [b31d4fc] Entered (VM test_affinity_2). >2014-10-05 14:38:03,678 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [b31d4fc] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 14:38:03,682 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:38:03,686 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: b8a8925 >2014-10-05 14:38:03,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 1ad0f08d >2014-10-05 14:38:04,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] FINISH, DestroyVDSCommand, log id: 1ad0f08d >2014-10-05 14:38:04,334 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] FINISH, DestroyVmVDSCommand, return: Down, log id: b8a8925 >2014-10-05 14:38:04,335 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-24) [6ae5d731] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:38:04,353 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [3c32b56c] Correlation ID: 3c32b56c, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:38:04,385 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [7495f221] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:04,387 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [7495f221] Entered (VM test_affinity_1). >2014-10-05 14:38:04,387 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-30) [7495f221] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 14:38:04,390 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-30) [1504b536] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:04,393 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1504b536] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 297ca873 >2014-10-05 14:38:04,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1504b536] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 7293844e >2014-10-05 14:38:04,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1504b536] FINISH, DestroyVDSCommand, log id: 7293844e >2014-10-05 14:38:04,898 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-19) [2fe962b0] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:38:04,899 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1504b536] FINISH, DestroyVmVDSCommand, return: Down, log id: 297ca873 >2014-10-05 14:38:04,914 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [1504b536] Correlation ID: 1504b536, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:38:15,121 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [57713aa2] Lock Acquired to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:38:15,170 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [57713aa2] Running command: UpdateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM, ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:15,226 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [57713aa2] Correlation ID: 57713aa2, Job ID: 98a84b13-4783-468c-8429-b9f54bb91b83, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 configuration was updated by admin. >2014-10-05 14:38:15,242 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [57713aa2] Lock freed to object EngineLock [exclusiveLocks= key: test_affinity_1 value: VM_NAME >, sharedLocks= ] >2014-10-05 14:38:16,832 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [5dfbdf01] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:38:16,854 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [5dfbdf01] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 6335edd0 >2014-10-05 14:38:16,855 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [5dfbdf01] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6335edd0 >2014-10-05 14:38:16,991 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:17,048 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] START, CreateVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 32163d3e >2014-10-05 14:38:17,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] START, CreateVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 4e0cf5b7 >2014-10-05 14:38:18,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1de01d8c-73c5-446e-821b-0f8bdd90b5f2, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fffaa657-e12b-41ae-bb0b-aceae48d1b42, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9b79fe64-e64c-4861-bce8-b6574e92f8d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6device_3c675ff9-1eb0-4f35-8c3b-35df694fefe3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3c675ff9-1eb0-4f35-8c3b-35df694fefe3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=27c929aa-caed-4650-a94a-510263612fa5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-10-05 14:38:18,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] FINISH, CreateVDSCommand, log id: 4e0cf5b7 >2014-10-05 14:38:18,068 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 32163d3e >2014-10-05 14:38:18,068 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:38:18,076 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [5dfbdf01] Correlation ID: 5dfbdf01, Job ID: 3f0eb398-71e4-43b8-8ac2-63b430cfda2a, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:38:20,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-63) START, DestroyVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 1f94f770 >2014-10-05 14:38:20,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, DestroyVDSCommand, log id: 1f94f770 >2014-10-05 14:38:20,261 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 is down. Exit message: Child quit during startup handshake: Input/output error. >2014-10-05 14:38:20,261 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) Running on vds during rerun failed vm: null >2014-10-05 14:38:20,262 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) VM test_affinity_1 (f2dcdf0d-59ef-467e-a803-ac0002baa9ae) is running in db and not running in VDS puma16.scl.lab.tlv.redhat.com >2014-10-05 14:38:20,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) START, FullListVdsCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vds=Host[puma16.scl.lab.tlv.redhat.com,27d8f2a3-df14-411c-9163-dead0f6754e4], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 60253175 >2014-10-05 14:38:20,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) FINISH, FullListVdsCommand, return: [], log id: 60253175 >2014-10-05 14:38:20,303 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) Rerun vm f2dcdf0d-59ef-467e-a803-ac0002baa9ae. Called from vds puma16.scl.lab.tlv.redhat.com >2014-10-05 14:38:20,312 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) Correlation ID: 5dfbdf01, Job ID: 3f0eb398-71e4-43b8-8ac2-63b430cfda2a, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test_affinity_1 on Host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:38:20,324 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:38:20,335 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-11) START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 7ae9e569 >2014-10-05 14:38:20,335 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-11) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7ae9e569 >2014-10-05 14:38:20,358 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:38:20,434 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 7257cfa5 >2014-10-05 14:38:20,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) START, CreateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 673c3006 >2014-10-05 14:38:20,901 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [4eb489a3] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:38:20,973 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [4eb489a3] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 74eb078b >2014-10-05 14:38:20,979 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [4eb489a3] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74eb078b >2014-10-05 14:38:21,004 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-9) [4eb489a3] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory >2014-10-05 14:38:21,149 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:38:21,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1de01d8c-73c5-446e-821b-0f8bdd90b5f2, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fffaa657-e12b-41ae-bb0b-aceae48d1b42, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9b79fe64-e64c-4861-bce8-b6574e92f8d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6device_3c675ff9-1eb0-4f35-8c3b-35df694fefe3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3c675ff9-1eb0-4f35-8c3b-35df694fefe3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=27c929aa-caed-4650-a94a-510263612fa5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-10-05 14:38:21,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) FINISH, CreateVDSCommand, log id: 673c3006 >2014-10-05 14:38:21,494 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7257cfa5 >2014-10-05 14:38:21,494 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:38:21,516 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) Correlation ID: 5dfbdf01, Job ID: 3f0eb398-71e4-43b8-8ac2-63b430cfda2a, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_2). >2014-10-05 14:38:31,238 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 4eb489a3) >2014-10-05 14:38:31,266 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] START, CreateVmVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 5a15b03e >2014-10-05 14:38:31,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] START, CreateVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 7d329350 >2014-10-05 14:38:32,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=87ed18b3-fcee-4ead-9073-7455b36c39ca, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=058ab61b-458c-403b-a515-dffbca7c3395, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=02f42cfc-7b6d-4639-8345-1802aaf10475, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475device_7f404995-0a18-4a15-96e3-fcddd9a42a61=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7f404995-0a18-4a15-96e3-fcddd9a42a61, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475device_7f404995-0a18-4a15-96e3-fcddd9a42a61device_4ce2bfe2-4352-4cc0-b0c2-223652feb1d0=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=4ce2bfe2-4352-4cc0-b0c2-223652feb1d0, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}} >2014-10-05 14:38:32,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] FINISH, CreateVDSCommand, log id: 7d329350 >2014-10-05 14:38:32,209 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5a15b03e >2014-10-05 14:38:32,209 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:38:32,218 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [4eb489a3] Correlation ID: 4eb489a3, Job ID: 200c8113-1f42-4db5-850f-2e34d77df8bc, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: puma16.scl.lab.tlv.redhat.com). >2014-10-05 14:38:32,557 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-90) START, FullListVdsCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vds=Host[puma16.scl.lab.tlv.redhat.com,27d8f2a3-df14-411c-9163-dead0f6754e4], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 75aeb6fe >2014-10-05 14:38:32,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-90) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39ca=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=87ed18b3-fcee-4ead-9073-7455b36c39ca, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=058ab61b-458c-403b-a515-dffbca7c3395, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=02f42cfc-7b6d-4639-8345-1802aaf10475, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475device_7f404995-0a18-4a15-96e3-fcddd9a42a61=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=7f404995-0a18-4a15-96e3-fcddd9a42a61, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_058ab61b-458c-403b-a515-dffbca7c3395device_87ed18b3-fcee-4ead-9073-7455b36c39cadevice_02f42cfc-7b6d-4639-8345-1802aaf10475device_7f404995-0a18-4a15-96e3-fcddd9a42a61device_4ce2bfe2-4352-4cc0-b0c2-223652feb1d0=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=4ce2bfe2-4352-4cc0-b0c2-223652feb1d0, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=-1, smp=1, emulatedMachine=rhel6.5.0, status=WaitForLaunch, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=0, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@21701a0e, vmName=test_affinity_2, cpuType=Conroe}], log id: 75aeb6fe >2014-10-05 14:38:32,649 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) Received a memballoon Device without an address when processing VM efe2c68c-1a43-4965-8419-884d13f0dda8 devices, skipping device: {specParams={model=virtio}, target=15360000, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2} >2014-10-05 14:38:35,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-91) START, DestroyVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 581745d7 >2014-10-05 14:38:35,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, DestroyVDSCommand, log id: 581745d7 >2014-10-05 14:38:35,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 is down. Exit message: Child quit during startup handshake: Input/output error. >2014-10-05 14:38:35,874 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Running on vds during rerun failed vm: null >2014-10-05 14:38:35,875 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM test_affinity_2 (efe2c68c-1a43-4965-8419-884d13f0dda8) is running in db and not running in VDS puma16.scl.lab.tlv.redhat.com >2014-10-05 14:38:35,882 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Rerun vm efe2c68c-1a43-4965-8419-884d13f0dda8. Called from vds puma16.scl.lab.tlv.redhat.com >2014-10-05 14:38:35,890 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) Correlation ID: 4eb489a3, Job ID: 200c8113-1f42-4db5-850f-2e34d77df8bc, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test_affinity_2 on Host puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:38:35,902 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:38:35,917 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-41) START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 2afed822 >2014-10-05 14:38:35,917 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2afed822 >2014-10-05 14:38:35,922 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-41) Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory >2014-10-05 14:38:35,922 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-41) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName hosted_engine_2,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON >2014-10-05 14:38:35,923 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-41) Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:38:35,938 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) Correlation ID: 4eb489a3, Job ID: 200c8113-1f42-4db5-850f-2e34d77df8bc, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test_affinity_2 (User: admin). >2014-10-05 14:38:35,939 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-44) [7d791bf8] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:38:43,164 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:38:43,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: a4297b7 >2014-10-05 14:38:43,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1de01d8c-73c5-446e-821b-0f8bdd90b5f2, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fffaa657-e12b-41ae-bb0b-aceae48d1b42, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9b79fe64-e64c-4861-bce8-b6574e92f8d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6device_3c675ff9-1eb0-4f35-8c3b-35df694fefe3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3c675ff9-1eb0-4f35-8c3b-35df694fefe3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=27c929aa-caed-4650-a94a-510263612fa5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5901, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=2176, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@d2127e9, vmName=test_affinity_1, cpuType=Conroe}], log id: a4297b7 >2014-10-05 14:38:59,917 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-13) [2684bbc4] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:38:59,919 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2684bbc4] START, SetVdsStatusVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 25f8c5ce >2014-10-05 14:38:59,940 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2684bbc4] FINISH, SetVdsStatusVDSCommand, log id: 25f8c5ce >2014-10-05 14:39:00,021 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-13) [2684bbc4] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:39:00,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [2684bbc4] Correlation ID: 2684bbc4, Job ID: aa857a1b-a7e7-4bfe-a641-ab77384e1743, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com was switched to Maintenance mode by admin. >2014-10-05 14:39:00,396 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 27d8f2a3-df14-411c-9163-dead0f6754e4 : puma16.scl.lab.tlv.redhat.com >2014-10-05 14:39:00,421 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-4) Clearing cache of pool: 00000002-0002-0002-0002-000000000366 for problematic entities of VDS: puma16.scl.lab.tlv.redhat.com. >2014-10-05 14:39:00,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-65) START, DisconnectStoragePoolVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 3), log id: 66624a19 >2014-10-05 14:39:04,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, DisconnectStoragePoolVDSCommand, log id: 66624a19 >2014-10-05 14:39:04,210 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-65) [7ff92284] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:39:04,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-65) [7ff92284] START, DisconnectStorageServerVDSCommand(HostName = puma16.scl.lab.tlv.redhat.com, HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3683bfc0 >2014-10-05 14:39:04,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-65) [7ff92284] FINISH, DisconnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 3683bfc0 >2014-10-05 14:39:04,801 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-8) [7b30ca8c] Lock Acquired to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:39:04,815 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 27d8f2a3-df14-411c-9163-dead0f6754e4 Type: VDS >2014-10-05 14:39:04,848 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] START, RemoveVdsVDSCommand( HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 779f61f2 >2014-10-05 14:39:04,848 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] vdsManager::disposing >2014-10-05 14:39:04,849 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] FINISH, RemoveVdsVDSCommand, log id: 779f61f2 >2014-10-05 14:39:04,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] Correlation ID: 7b30ca8c, Call Stack: null, Custom Event ID: -1, Message: Host puma16.scl.lab.tlv.redhat.com was removed by admin. >2014-10-05 14:39:04,861 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-9) [7b30ca8c] Lock freed to object EngineLock [exclusiveLocks= key: 27d8f2a3-df14-411c-9163-dead0f6754e4 value: VDS >, sharedLocks= ] >2014-10-05 14:39:24,124 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:39:24,164 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) Correlation ID: 5dfbdf01, Job ID: 3f0eb398-71e4-43b8-8ac2-63b430cfda2a, Call Stack: null, Custom Event ID: -1, Message: Guest test_affinity_1 started on Host hosted_engine_2. (Default Host parameter was ignored - assigned Host was not available). >2014-10-05 14:39:24,171 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (org.ovirt.thread.pool-4-thread-49) Cannot get vdsManager for vdsid=27d8f2a3-df14-411c-9163-dead0f6754e4 >2014-10-05 14:39:24,173 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-49) START, FailedToRunVmVDSCommand( HostId = 27d8f2a3-df14-411c-9163-dead0f6754e4), log id: 188f7a18 >2014-10-05 14:39:24,173 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-49) FINISH, FailedToRunVmVDSCommand, log id: 188f7a18 >2014-10-05 14:39:25,127 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [3369b815] Lock Acquired to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:39:25,174 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:39:25,175 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] Before acquiring lock in order to prevent monitoring for host hosted_engine_1 from data-center Default >2014-10-05 14:39:25,175 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_1 from data-center Default >2014-10-05 14:39:25,186 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3e9e7514 >2014-10-05 14:39:25,204 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] FINISH, SetVdsStatusVDSCommand, log id: 3e9e7514 >2014-10-05 14:39:25,248 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 799799f0 >2014-10-05 14:39:25,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] FINISH, SetHaMaintenanceModeVDSCommand, log id: 799799f0 >2014-10-05 14:39:25,277 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] Activate finished. Lock released. Monitoring can run now for host hosted_engine_1 from data-center Default >2014-10-05 14:39:25,285 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3369b815] Correlation ID: 3369b815, Job ID: 0a212d25-8973-492d-adfd-636ad1936365, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was activated by admin. >2014-10-05 14:39:25,290 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3369b815] Lock freed to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:39:25,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 1ed8d75 >2014-10-05 14:39:25,498 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GetHardwareInfoVDSCommand, log id: 1ed8d75 >2014-10-05 14:39:25,531 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-28) [c1e8858] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:39:25,541 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [c1e8858] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 14:39:25,561 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-28) [6f0091ee] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:39:25,567 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:39:25,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4795d9d5 >2014-10-05 14:39:25,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 4795d9d5 >2014-10-05 14:39:25,715 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] Host hosted_engine_1 storage connection was succeeded >2014-10-05 14:39:25,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-8) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 3f214020 >2014-10-05 14:39:25,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-8) FINISH, ConnectStoragePoolVDSCommand, log id: 3f214020 >2014-10-05 14:39:26,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 4279cbad >2014-10-05 14:39:26,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-28) [6bac60b7] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4279cbad >2014-10-05 14:39:26,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [6bac60b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. >2014-10-05 14:39:26,232 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-28) [59c85879] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:39:34,973 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-2) [48246f84] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:39:35,034 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] Running command: MigrateVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:39:35,068 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 109d908e >2014-10-05 14:39:35,068 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstHost=10.35.97.36:54321, method=online >2014-10-05 14:39:35,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.64.85, dstVdsId=25466fb3-6dfd-4f53-82ce-c622f4ab7726, dstHost=10.35.97.36:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 74456aa2 >2014-10-05 14:39:35,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] FINISH, MigrateBrokerVDSCommand, log id: 74456aa2 >2014-10-05 14:39:35,163 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-29) [48246f84] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 109d908e >2014-10-05 14:39:35,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [48246f84] Correlation ID: 48246f84, Job ID: 58d6acc9-1dda-4903-a19b-6e9ed21a0d74, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, User: admin). >2014-10-05 14:39:35,508 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:39:38,573 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-51) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:39:41,636 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:39:44,731 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:39:47,937 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:39:51,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-75) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: de365b4 >2014-10-05 14:39:51,227 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-75) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1de01d8c-73c5-446e-821b-0f8bdd90b5f2, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fffaa657-e12b-41ae-bb0b-aceae48d1b42, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9b79fe64-e64c-4861-bce8-b6574e92f8d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6device_3c675ff9-1eb0-4f35-8c3b-35df694fefe3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3c675ff9-1eb0-4f35-8c3b-35df694fefe3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=27c929aa-caed-4650-a94a-510263612fa5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=19472, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@4c2a138b, vmName=test_affinity_1, cpuType=Conroe}], log id: de365b4 >2014-10-05 14:39:51,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: 48246f84, Job ID: 58d6acc9-1dda-4903-a19b-6e9ed21a0d74, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 16 sec). >2014-10-05 14:39:51,281 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-75) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:39:51,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 5727dd60 >2014-10-05 14:39:51,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, DestroyVDSCommand, log id: 5727dd60 >2014-10-05 14:39:51,868 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae status = Down on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:39:53,998 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [51209323] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:39:54,018 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [51209323] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 5410264f >2014-10-05 14:39:54,018 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [51209323] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5410264f >2014-10-05 14:39:54,032 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-3) [51209323] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups >2014-10-05 14:39:54,083 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:39:54,101 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-50) [51209323] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter VmAffinityGroups (correlation id: 51209323) >2014-10-05 14:39:54,144 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 21ad5fbb >2014-10-05 14:39:54,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 36eb0d83 >2014-10-05 14:39:55,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={} >2014-10-05 14:39:55,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] FINISH, CreateVDSCommand, log id: 36eb0d83 >2014-10-05 14:39:55,186 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 21ad5fbb >2014-10-05 14:39:55,186 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-50) [51209323] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:39:55,208 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [51209323] Correlation ID: 51209323, Job ID: 94ff79ef-3d3d-41bc-8a1e-b7ada2fad9b4, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_1). >2014-10-05 14:39:58,395 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:39:58,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 3e72dde3 >2014-10-05 14:39:58,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=20343, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@9adcae1, vmName=test_affinity_2, cpuType=Conroe}], log id: 3e72dde3 >2014-10-05 14:40:57,960 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:40:57,972 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: 51209323, Job ID: 94ff79ef-3d3d-41bc-8a1e-b7ada2fad9b4, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_1 >2014-10-05 14:42:09,487 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:42:09,489 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 73863ad3 >2014-10-05 14:42:09,500 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] FINISH, SetVdsStatusVDSCommand, log id: 73863ad3 >2014-10-05 14:42:09,544 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:42:09,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 44ac10bb >2014-10-05 14:42:09,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-42) [2d683962] FINISH, SetHaMaintenanceModeVDSCommand, log id: 44ac10bb >2014-10-05 14:42:09,612 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:42:09,653 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:42:09,677 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: ea63cf3 >2014-10-05 14:42:09,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] VdsBroker::migrate::Entered (vm_guid=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstHost=10.35.64.85:54321, method=online >2014-10-05 14:42:09,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, srcHost=10.35.97.36, dstVdsId=a6249d4e-b23d-4a14-9f56-a0761d824721, dstHost=10.35.64.85:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 5ea86ff2 >2014-10-05 14:42:09,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] FINISH, MigrateBrokerVDSCommand, log id: 5ea86ff2 >2014-10-05 14:42:09,750 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1fbbdd8] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: ea63cf3 >2014-10-05 14:42:09,775 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [22d55431] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:42:09,788 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-42) [22d55431] Candidate host hosted_engine_2 (a6249d4e-b23d-4a14-9f56-a0761d824721) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory >2014-10-05 14:42:09,788 WARN [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [22d55431] CanDoAction of action InternalMigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName hosted_engine_2,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON >2014-10-05 14:42:09,788 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-42) [22d55431] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:42:09,804 ERROR [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-42) [22d55431] ResourceManager::vdsMaintenance - Failed migrating desktop test_affinity_2 >2014-10-05 14:42:09,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [22d55431] Correlation ID: 2d683962, Job ID: d48cb32c-900a-404e-9508-10f62428916b, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 cannot change into maintenance mode - not all Vms have been migrated successfully. Consider manual intervention: stopping/migrating Vms: test_affinity_2 (User: admin). >2014-10-05 14:42:10,778 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:42:13,847 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) [50465574] RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:42:17,024 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) [59c85879] RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:42:20,109 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-21) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 14:42:23,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 43cb78f9 >2014-10-05 14:42:23,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1de01d8c-73c5-446e-821b-0f8bdd90b5f2, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fffaa657-e12b-41ae-bb0b-aceae48d1b42, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=9b79fe64-e64c-4861-bce8-b6574e92f8d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5device_1de01d8c-73c5-446e-821b-0f8bdd90b5f2device_fffaa657-e12b-41ae-bb0b-aceae48d1b42device_9b79fe64-e64c-4861-bce8-b6574e92f8d6device_3c675ff9-1eb0-4f35-8c3b-35df694fefe3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=3c675ff9-1eb0-4f35-8c3b-35df694fefe3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_27c929aa-caed-4650-a94a-510263612fa5=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=27c929aa-caed-4650-a94a-510263612fa5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, smp=1, displayPort=5901, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=15000, display=qxl, pid=9980, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@63734634, vmName=test_affinity_1, cpuType=Conroe}], log id: 43cb78f9 >2014-10-05 14:42:23,389 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: 1fbbdd8, Job ID: d48cb32c-900a-404e-9508-10f62428916b, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test_affinity_1, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 13 sec). >2014-10-05 14:42:23,389 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-39) Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:42:24,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-34) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 7f532faf >2014-10-05 14:42:24,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, DestroyVDSCommand, log id: 7f532faf >2014-10-05 14:42:24,510 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) RefreshVmList vm id f2dcdf0d-59ef-467e-a803-ac0002baa9ae status = Down on vds hosted_engine_1 ignoring it in the refresh until migration is done >2014-10-05 14:44:46,533 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-2) [156de452] Lock Acquired to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:44:46,575 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:44:46,575 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] Before acquiring lock in order to prevent monitoring for host hosted_engine_1 from data-center Default >2014-10-05 14:44:46,575 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_1 from data-center Default >2014-10-05 14:44:46,618 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 418973f8 >2014-10-05 14:44:46,637 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] FINISH, SetVdsStatusVDSCommand, log id: 418973f8 >2014-10-05 14:44:46,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 3fe1ed31 >2014-10-05 14:44:46,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] FINISH, SetHaMaintenanceModeVDSCommand, log id: 3fe1ed31 >2014-10-05 14:44:46,707 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] Activate finished. Lock released. Monitoring can run now for host hosted_engine_1 from data-center Default >2014-10-05 14:44:46,716 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [156de452] Correlation ID: 156de452, Job ID: b4e3ecdc-2aaa-42e4-82d2-50a60808fdca, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was activated by admin. >2014-10-05 14:44:46,724 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [156de452] Lock freed to object EngineLock [exclusiveLocks= key: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 value: VDS >, sharedLocks= ] >2014-10-05 14:44:46,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) [7ff92284] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 258347a9 >2014-10-05 14:44:46,969 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) [7ff92284] FINISH, GetHardwareInfoVDSCommand, log id: 258347a9 >2014-10-05 14:44:47,002 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-65) [1bbc7f9d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:44:47,016 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [1bbc7f9d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 14:44:47,054 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-65) [15484626] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:44:47,062 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 14:44:47,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, storageType = NFS, connectionList = [{ id: a7462a0f-02b1-4185-931d-98a185b2baa2, connection: 10.35.160.108:/RHEV/artyom_hosted_engine_storage_34, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e94cb47 >2014-10-05 14:44:47,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] FINISH, ConnectStorageServerVDSCommand, return: {a7462a0f-02b1-4185-931d-98a185b2baa2=0}, log id: 4e94cb47 >2014-10-05 14:44:47,207 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] Host hosted_engine_1 storage connection was succeeded >2014-10-05 14:44:47,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, storagePoolId = 00000002-0002-0002-0002-000000000366, vds_spm_id = 1, masterDomainId = 12a6a966-7a3e-4fcb-94d2-4ff58271527d, masterVersion = 1), log id: 1700a7de >2014-10-05 14:44:47,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) FINISH, ConnectStoragePoolVDSCommand, log id: 1700a7de >2014-10-05 14:44:47,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726), log id: 7afb1420 >2014-10-05 14:44:47,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-65) [361227f6] FINISH, SetMOMPolicyParametersVDSCommand, log id: 7afb1420 >2014-10-05 14:44:47,823 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [361227f6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. >2014-10-05 14:44:47,841 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-65) [3599769a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 14:45:54,780 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:46:28,941 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-1) [2c5c0ed4] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:46:28,953 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ajp-/127.0.0.1:8702-1) [2c5c0ed4] Candidate host hosted_engine_1 (25466fb3-6dfd-4f53-82ce-c622f4ab7726) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory >2014-10-05 14:46:28,953 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-1) [2c5c0ed4] CanDoAction of action MigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VDS_VM_MEMORY,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName hosted_engine_1,$filterName Memory,SCHEDULING_HOST_FILTERED_REASON >2014-10-05 14:46:28,953 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-1) [2c5c0ed4] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:46:44,815 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:46:44,817 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] Entered (VM test_affinity_1). >2014-10-05 14:46:44,817 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] Sending shutdown command for VM test_affinity_1. >2014-10-05 14:46:44,821 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 54dcbbf3 >2014-10-05 14:46:44,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 63bc47ce >2014-10-05 14:46:44,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] FINISH, DestroyVDSCommand, log id: 63bc47ce >2014-10-05 14:46:44,962 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-23) [413d2598] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 54dcbbf3 >2014-10-05 14:46:44,992 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [413d2598] Correlation ID: 413d2598, Job ID: 707ae75b-5eaa-44c6-916b-e859f336d77a, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_2). >2014-10-05 14:46:48,453 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-3) [c826425] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:46:48,455 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-3) [c826425] Entered (VM test_affinity_1). >2014-10-05 14:46:48,456 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-3) [c826425] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 14:46:48,489 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-3) [1697585] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:46:48,493 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1697585] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 50deb912 >2014-10-05 14:46:48,498 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1697585] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 700a28e >2014-10-05 14:46:49,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1697585] FINISH, DestroyVDSCommand, log id: 700a28e >2014-10-05 14:46:49,100 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-13) [3a96fc95] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:46:49,101 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1697585] FINISH, DestroyVmVDSCommand, return: Down, log id: 50deb912 >2014-10-05 14:46:49,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [1697585] Correlation ID: 1697585, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:49:02,957 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:49:02,960 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] Entered (VM test_affinity_2). >2014-10-05 14:49:02,960 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] Sending shutdown command for VM test_affinity_2. >2014-10-05 14:49:02,964 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 7b0e6897 >2014-10-05 14:49:02,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 185be790 >2014-10-05 14:49:03,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] FINISH, DestroyVDSCommand, log id: 185be790 >2014-10-05 14:49:04,503 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-8) [602925ae] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 7b0e6897 >2014-10-05 14:49:04,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [602925ae] Correlation ID: 602925ae, Job ID: 3b045917-0ea7-4d51-b776-3ff9e179c04e, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_1). >2014-10-05 14:49:05,434 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-41) [4d6b36e5] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:49:05,436 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-41) [4d6b36e5] Entered (VM test_affinity_2). >2014-10-05 14:49:05,436 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-41) [4d6b36e5] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 14:49:05,443 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-41) [640143fb] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:49:05,448 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-41) [640143fb] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 27b04f1a >2014-10-05 14:49:05,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-41) [640143fb] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 2253006b >2014-10-05 14:49:06,041 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-41) [640143fb] FINISH, DestroyVDSCommand, log id: 2253006b >2014-10-05 14:49:06,055 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-41) [640143fb] FINISH, DestroyVmVDSCommand, return: Down, log id: 27b04f1a >2014-10-05 14:49:06,055 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-1) [6acc25bb] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:49:06,075 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [640143fb] Correlation ID: 640143fb, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_1). >2014-10-05 14:49:34,270 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:49:34,271 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-1) [4de79a8f] Start running CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:49:34,271 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-41) [3605c3] Start running CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:49:34,272 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-41) [3605c3] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:49:34,280 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-1) [4de79a8f] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:49:34,309 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-41) [3605c3] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 3d922b1d >2014-10-05 14:49:34,309 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-41) [3605c3] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3d922b1d >2014-10-05 14:49:34,309 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-1) [4de79a8f] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 76b67a6a >2014-10-05 14:49:34,309 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-1) [4de79a8f] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76b67a6a >2014-10-05 14:49:34,363 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-1) [4de79a8f] Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:49:34,373 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-41) [3605c3] Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:49:34,408 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:49:34,429 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] Started HA reservation scoring method >2014-10-05 14:49:34,450 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 7e9c7052 >2014-10-05 14:49:34,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: faebdc8 >2014-10-05 14:49:35,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4device_d025e604-bb44-431e-87e3-a03bb37273d7=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d025e604-bb44-431e-87e3-a03bb37273d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fc1337e9-3589-4184-8736-3504d7667396, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a481a610-68ce-4354-8230-bfc568fd3c22, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d72be78d-7934-4475-800c-57e73d3c68a4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=4e626d45-a4be-49c7-8a21-2ddcbb0775a0, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-10-05 14:49:35,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] FINISH, CreateVDSCommand, log id: faebdc8 >2014-10-05 14:49:35,366 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7e9c7052 >2014-10-05 14:49:35,366 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:49:35,376 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [4de79a8f] Correlation ID: 4de79a8f, Job ID: 8c4f0148-051c-476d-ad75-a61af7cf4eaa, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 14:49:35,408 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:49:36,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 60d6f5ae >2014-10-05 14:49:36,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4device_d025e604-bb44-431e-87e3-a03bb37273d7=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d025e604-bb44-431e-87e3-a03bb37273d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fc1337e9-3589-4184-8736-3504d7667396, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a481a610-68ce-4354-8230-bfc568fd3c22, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d72be78d-7934-4475-800c-57e73d3c68a4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=4e626d45-a4be-49c7-8a21-2ddcbb0775a0, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=-1, smp=1, emulatedMachine=rhel6.5.0, status=WaitForLaunch, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=0, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@3d516add, vmName=test_affinity_1, cpuType=Conroe}], log id: 60d6f5ae >2014-10-05 14:49:36,610 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) Received a memballoon Device without an address when processing VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae devices, skipping device: {specParams={model=virtio}, target=15360000, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16} >2014-10-05 14:49:39,746 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:49:39,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-60) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 4157bff1 >2014-10-05 14:49:39,853 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-60) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4device_d025e604-bb44-431e-87e3-a03bb37273d7=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d025e604-bb44-431e-87e3-a03bb37273d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=fc1337e9-3589-4184-8736-3504d7667396, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=a481a610-68ce-4354-8230-bfc568fd3c22, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0device_fc1337e9-3589-4184-8736-3504d7667396device_a481a610-68ce-4354-8230-bfc568fd3c22device_d72be78d-7934-4475-800c-57e73d3c68a4=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d72be78d-7934-4475-800c-57e73d3c68a4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_4e626d45-a4be-49c7-8a21-2ddcbb0775a0=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=4e626d45-a4be-49c7-8a21-2ddcbb0775a0, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=8051, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@67fa88ba, vmName=test_affinity_1, cpuType=Conroe}], log id: 4157bff1 >2014-10-05 14:49:39,890 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-5) [3605c3] Candidate host hosted_engine_1 (25466fb3-6dfd-4f53-82ce-c622f4ab7726) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 3605c3) >2014-10-05 14:49:39,939 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 6c0ee36e >2014-10-05 14:49:39,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] START, CreateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 75806e3b >2014-10-05 14:49:40,862 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4device_1ea8e544-4947-48f7-90bb-58d3ab144841device_753c757f-39b5-4860-abe7-a3f9d85b6402=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=753c757f-39b5-4860-abe7-a3f9d85b6402, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=24240b60-98d6-47dc-b197-ed6b55f03702, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=50d9dcf1-9883-487c-ac7b-a0617f2cb6c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=dbab8fd6-22dd-4640-8ac0-d04e73c101e7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4device_1ea8e544-4947-48f7-90bb-58d3ab144841=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1ea8e544-4947-48f7-90bb-58d3ab144841, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-05 14:49:40,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] FINISH, CreateVDSCommand, log id: 75806e3b >2014-10-05 14:49:40,873 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6c0ee36e >2014-10-05 14:49:40,874 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) [3605c3] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:49:40,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [3605c3] Correlation ID: 3605c3, Job ID: f7ac553c-95d4-455d-9ce4-634991285891, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_2). >2014-10-05 14:49:42,697 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) [c0c7d94] VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:49:42,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-58) [c0c7d94] START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 60549bf8 >2014-10-05 14:49:42,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-58) [c0c7d94] FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4device_1ea8e544-4947-48f7-90bb-58d3ab144841device_753c757f-39b5-4860-abe7-a3f9d85b6402=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=753c757f-39b5-4860-abe7-a3f9d85b6402, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=24240b60-98d6-47dc-b197-ed6b55f03702, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=50d9dcf1-9883-487c-ac7b-a0617f2cb6c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=dbab8fd6-22dd-4640-8ac0-d04e73c101e7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_24240b60-98d6-47dc-b197-ed6b55f03702device_dbab8fd6-22dd-4640-8ac0-d04e73c101e7device_50d9dcf1-9883-487c-ac7b-a0617f2cb6c4device_1ea8e544-4947-48f7-90bb-58d3ab144841=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1ea8e544-4947-48f7-90bb-58d3ab144841, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5901, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=26577, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@52cbe830, vmName=test_affinity_2, cpuType=Conroe}], log id: 60549bf8 >2014-10-05 14:50:09,511 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:50:37,844 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:50:37,886 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: 4de79a8f, Job ID: 8c4f0148-051c-476d-ad75-a61af7cf4eaa, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 started on Host hosted_engine_1 >2014-10-05 14:50:41,074 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-100) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:50:41,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-100) Correlation ID: 3605c3, Job ID: f7ac553c-95d4-455d-9ce4-634991285891, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_2 >2014-10-05 14:51:57,824 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:51:57,824 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-41) [48805ac4] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:51:57,825 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-12) [62c71f0b] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:51:57,835 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-12) [62c71f0b] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:51:57,856 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-41) [48805ac4] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:51:57,884 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:51:57,886 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] Entered (VM test_affinity_2). >2014-10-05 14:51:57,886 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] Sending shutdown command for VM test_affinity_2. >2014-10-05 14:51:57,891 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 60a65e0d >2014-10-05 14:51:57,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 512d01c1 >2014-10-05 14:51:57,964 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] FINISH, DestroyVDSCommand, log id: 512d01c1 >2014-10-05 14:51:57,979 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48805ac4] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 60a65e0d >2014-10-05 14:51:57,990 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [48805ac4] Correlation ID: 48805ac4, Job ID: 5e97cc06-b388-40de-92ad-f0a67a8f4d55, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_2). >2014-10-05 14:51:58,047 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:51:58,049 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] Entered (VM test_affinity_1). >2014-10-05 14:51:58,049 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] Sending shutdown command for VM test_affinity_1. >2014-10-05 14:51:58,051 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 4f9e2550 >2014-10-05 14:51:58,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 4cd1850d >2014-10-05 14:51:58,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] FINISH, DestroyVDSCommand, log id: 4cd1850d >2014-10-05 14:51:58,123 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 4f9e2550 >2014-10-05 14:51:58,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [62c71f0b] Correlation ID: 62c71f0b, Job ID: 755cbec8-616d-4b09-983b-cff0bc7fa301, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_1). >2014-10-05 14:52:02,717 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-37) [692699a3] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:52:02,718 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-48) [6530d243] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:52:02,725 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-37) [692699a3] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 14:52:02,727 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-48) [6530d243] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 14:52:02,762 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [692699a3] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:52:02,765 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [692699a3] Entered (VM test_affinity_2). >2014-10-05 14:52:02,765 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [692699a3] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 14:52:02,770 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:52:02,773 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 4675c21f >2014-10-05 14:52:02,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: f2ba30b >2014-10-05 14:52:03,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] FINISH, DestroyVDSCommand, log id: f2ba30b >2014-10-05 14:52:03,312 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] FINISH, DestroyVmVDSCommand, return: Down, log id: 4675c21f >2014-10-05 14:52:03,312 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-43) [6d98e2db] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:52:03,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [5cb1319b] Correlation ID: 5cb1319b, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 14:52:03,364 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [6530d243] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:52:03,366 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [6530d243] Entered (VM test_affinity_1). >2014-10-05 14:52:03,366 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-26) [6530d243] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 14:52:03,370 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-26) [5db0224b] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:52:03,374 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5db0224b] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 1b214943 >2014-10-05 14:52:03,379 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5db0224b] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 5b6fcad2 >2014-10-05 14:52:03,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5db0224b] FINISH, DestroyVDSCommand, log id: 5b6fcad2 >2014-10-05 14:52:03,849 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5db0224b] FINISH, DestroyVmVDSCommand, return: Down, log id: 1b214943 >2014-10-05 14:52:03,850 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-40) [60e21af5] Running command: ProcessDownVmCommand internal: true. >2014-10-05 14:52:03,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [5db0224b] Correlation ID: 5db0224b, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_1). >2014-10-05 14:52:28,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-10-05 14:52:28,414 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VM OVFs in Data Center Default >2014-10-05 14:52:28,731 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-42) START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 3), log id: 2f5af2ce >2014-10-05 14:52:30,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, UpdateVMVDSCommand, log id: 2f5af2ce >2014-10-05 14:52:30,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated VM OVFs in Data Center Default >2014-10-05 14:52:30,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update template OVFs in Data Center Default >2014-10-05 14:52:30,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated templates OVFs in Data Center Default >2014-10-05 14:52:30,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-10-05 14:52:30,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully removed unneeded template/vm OVFs in Data Center Default >2014-10-05 14:52:34,657 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 14:52:34,657 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-47) [7988cea1] Start running CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:52:34,657 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-8) [468b630d] Start running CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:52:34,660 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-8) [468b630d] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:52:34,660 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-47) [7988cea1] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:52:34,685 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-47) [7988cea1] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 998056a >2014-10-05 14:52:34,685 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-47) [7988cea1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 998056a >2014-10-05 14:52:34,724 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-8) [468b630d] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 20a7e47c >2014-10-05 14:52:34,724 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-8) [468b630d] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 20a7e47c >2014-10-05 14:52:34,810 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-47) [7988cea1] Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 14:52:34,836 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-8) [468b630d] Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 14:52:34,867 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 14:52:34,930 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-2) [468b630d] Started HA reservation scoring method >2014-10-05 14:52:34,994 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: bce32e0 >2014-10-05 14:52:35,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 2a052bed >2014-10-05 14:52:35,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d65be4e0-89ba-41ac-907c-4e0c62f29444, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=6ec753ab-5911-4fb5-a0d9-3cea95c0df24, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444device_1b015b4e-8618-4e3d-85c6-9a8391db50c3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1b015b4e-8618-4e3d-85c6-9a8391db50c3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e4312e31-c19a-4136-a269-24e2aec5d9a9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-10-05 14:52:35,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] FINISH, CreateVDSCommand, log id: 2a052bed >2014-10-05 14:52:35,949 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: bce32e0 >2014-10-05 14:52:35,949 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [468b630d] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 14:52:35,962 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [468b630d] Correlation ID: 468b630d, Job ID: b4a342c6-5581-4dda-bec9-5bdae8412273, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 14:52:36,042 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 14:52:39,137 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 14:52:39,160 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-2) [7988cea1] Candidate host hosted_engine_1 (25466fb3-6dfd-4f53-82ce-c622f4ab7726) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 7988cea1) >2014-10-05 14:52:39,262 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 6998d481 >2014-10-05 14:52:39,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] START, CreateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 22a153ba >2014-10-05 14:52:40,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1f2f2858-bb25-4fa8-b621-90b348713220, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=5a778c17-c2af-4c1a-b0ac-db8d037779a4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=9b9ebcdd-4833-4d25-89fd-062d99da87c3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b3c90b2a-0447-4a1a-80d1-7085dfc13bc5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220device_f835ff24-09c6-42f0-8727-ed73ff322029=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=f835ff24-09c6-42f0-8727-ed73ff322029, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-10-05 14:52:40,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] FINISH, CreateVDSCommand, log id: 22a153ba >2014-10-05 14:52:40,207 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6998d481 >2014-10-05 14:52:40,207 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [7988cea1] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 14:52:40,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [7988cea1] Correlation ID: 7988cea1, Job ID: 92456ca3-04fb-4620-9269-615600767038, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_2). >2014-10-05 14:52:42,281 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-82) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 14:53:36,260 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 14:53:36,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) Correlation ID: 468b630d, Job ID: b4a342c6-5581-4dda-bec9-5bdae8412273, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 started on Host hosted_engine_1 >2014-10-05 14:53:42,721 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-35) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 14:53:42,740 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) Correlation ID: 7988cea1, Job ID: 92456ca3-04fb-4620-9269-615600767038, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_2 >2014-10-05 15:06:24,257 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-13) Failed to invoke scheduled method recoverFromError: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_65] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.lang.NullPointerException > at org.ovirt.engine.core.vdsbroker.VdsManager.recoverFromError(VdsManager.java:460) [vdsbroker.jar:] > ... 7 more > >2014-10-05 15:06:30,936 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-44) [635113cc] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 15:06:30,937 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-39) [5feae904] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 15:06:30,990 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-39) [5feae904] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 15:06:31,002 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-44) [635113cc] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 15:06:31,046 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 15:06:31,048 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] Entered (VM test_affinity_2). >2014-10-05 15:06:31,048 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] Sending shutdown command for VM test_affinity_2. >2014-10-05 15:06:31,050 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 320f42cf >2014-10-05 15:06:31,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=30, gracefully=true), log id: 8a99c >2014-10-05 15:06:31,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] FINISH, DestroyVDSCommand, log id: 8a99c >2014-10-05 15:06:31,165 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) [635113cc] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 320f42cf >2014-10-05 15:06:31,192 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [635113cc] Correlation ID: 635113cc, Job ID: f8d2d5b2-25c2-45f5-83b5-b8b7767aace0, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_2 (Host: hosted_engine_2). >2014-10-05 15:06:32,508 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 15:06:32,511 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] Entered (VM test_affinity_1). >2014-10-05 15:06:32,511 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] Sending shutdown command for VM test_affinity_1. >2014-10-05 15:06:32,513 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 20156970 >2014-10-05 15:06:32,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=30, gracefully=true), log id: 35d37b39 >2014-10-05 15:06:32,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] FINISH, DestroyVDSCommand, log id: 35d37b39 >2014-10-05 15:06:32,589 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-13) [5feae904] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 20156970 >2014-10-05 15:06:32,607 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [5feae904] Correlation ID: 5feae904, Job ID: 08358c8c-4038-4242-afb3-c75f7b78d280, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM test_affinity_1 (Host: hosted_engine_1). >2014-10-05 15:06:33,286 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-7) [6785d44b] Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 15:06:33,293 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-14) [334bd06] Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 15:06:33,299 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-14) [334bd06] Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2014-10-05 15:06:33,325 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-7) [6785d44b] Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2014-10-05 15:06:33,366 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [6785d44b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 15:06:33,368 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [6785d44b] Entered (VM test_affinity_2). >2014-10-05 15:06:33,368 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [6785d44b] Cannot shutdown VM test_affinity_2, status is not up. Stopping instead. >2014-10-05 15:06:33,373 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-15) [44da48c5] Running command: StopVmCommand internal: true. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 15:06:33,380 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-15) [44da48c5] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 105a20e6 >2014-10-05 15:06:33,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-15) [44da48c5] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, force=false, secondsToWait=0, gracefully=false), log id: 4e4d38bd >2014-10-05 15:06:33,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-15) [44da48c5] FINISH, DestroyVDSCommand, log id: 4e4d38bd >2014-10-05 15:06:33,919 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-15) [44da48c5] FINISH, DestroyVmVDSCommand, return: Down, log id: 105a20e6 >2014-10-05 15:06:33,919 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-1) [5e6e4c9b] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:06:33,957 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [44da48c5] Correlation ID: 44da48c5, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was powered off ungracefully by admin (Host: hosted_engine_2). >2014-10-05 15:06:34,000 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [334bd06] Running command: ShutdownVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 15:06:34,002 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [334bd06] Entered (VM test_affinity_1). >2014-10-05 15:06:34,002 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-4-thread-15) [334bd06] Cannot shutdown VM test_affinity_1, status is not up. Stopping instead. >2014-10-05 15:06:34,007 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-15) [55f019fe] Running command: StopVmCommand internal: true. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 15:06:34,010 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-15) [55f019fe] START, DestroyVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: 22ab2015 >2014-10-05 15:06:34,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-15) [55f019fe] START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, force=false, secondsToWait=0, gracefully=false), log id: ad47e90 >2014-10-05 15:06:34,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-15) [55f019fe] FINISH, DestroyVDSCommand, log id: ad47e90 >2014-10-05 15:06:34,456 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-41) [372ca12f] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:06:34,460 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-15) [55f019fe] FINISH, DestroyVmVDSCommand, return: Down, log id: 22ab2015 >2014-10-05 15:06:34,478 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [55f019fe] Correlation ID: 55f019fe, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was powered off ungracefully by admin (Host: hosted_engine_1). >2014-10-05 15:12:26,985 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-05 15:12:26,991 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-05 15:12:26,991 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-05 15:12:26,991 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-05 15:12:26,992 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_USER" is "engine". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_FQDN" is "hosted_test.qa.lab.tlv.redhat.com". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-05 15:12:26,993 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USER" is "ovirt". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-05 15:12:26,994 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-05 15:12:28,143 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Start initializing Backend >2014-10-05 15:12:28,459 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 37) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-05 15:12:28,591 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Running ovirt-engine 3.4.3-1.1.el6ev >2014-10-05 15:12:28,592 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 37) Start initializing dictionaries >2014-10-05 15:12:28,594 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 37) Finished initializing dictionaries >2014-10-05 15:12:28,594 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Start initializing AuditLogCleanupManager >2014-10-05 15:12:28,594 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-05 15:12:28,612 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Finished initializing AuditLogCleanupManager >2014-10-05 15:12:28,614 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Start initializing TagsDirector >2014-10-05 15:12:28,626 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag root added to tree >2014-10-05 15:12:28,643 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Finished initializing TagsDirector >2014-10-05 15:12:28,645 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 37) Start initializing IsoDomainListSyncronizer >2014-10-05 15:12:28,650 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 37) Finished initializing IsoDomainListSyncronizer >2014-10-05 15:12:28,698 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Completed initializing handlers >2014-10-05 15:12:28,699 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Start initializing ErrorTranslatorImpl >2014-10-05 15:12:28,706 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-05 15:12:28,707 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Finished initializing ErrorTranslatorImpl >2014-10-05 15:12:28,707 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Start initializing ErrorTranslatorImpl >2014-10-05 15:12:28,707 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Finished initializing ErrorTranslatorImpl >2014-10-05 15:12:28,707 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Mark incomplete jobs as UNKNOWN >2014-10-05 15:12:28,753 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 37) Start initializing JobRepositoryCleanupManager >2014-10-05 15:12:28,754 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 37) Finished initializing JobRepositoryCleanupManager >2014-10-05 15:12:28,755 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 37) Start initializing AutoRecoveryManager >2014-10-05 15:12:28,756 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 37) Finished initializing AutoRecoveryManager >2014-10-05 15:12:28,759 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 37) Start initializing ExecutionMessageDirector >2014-10-05 15:12:28,761 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 37) Finished initializing ExecutionMessageDirector >2014-10-05 15:12:28,949 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 42) Start initializing UsersDomainsCacheManagerService >2014-10-05 15:12:28,954 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 42) Start initializing DbUserCacheManager >2014-10-05 15:12:28,961 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 42) Finished initializing DbUserCacheManager >2014-10-05 15:12:28,961 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 42) Finished initializing UsersDomainsCacheManagerService >2014-10-05 15:12:29,010 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 40) Initialization of AsyncTaskManager completed successfully. >2014-10-05 15:12:29,012 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 40) Start initializing ResourceManager >2014-10-05 15:12:29,233 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 40) Entered VdsManager constructor >2014-10-05 15:12:29,283 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 40) Initialize vdsBroker (10.35.97.36,54,321) >2014-10-05 15:12:29,466 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 40) VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added to the Resource Manager >2014-10-05 15:12:29,466 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 40) Entered VdsManager constructor >2014-10-05 15:12:29,478 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 40) Initialize vdsBroker (10.35.64.85,54,321) >2014-10-05 15:12:29,488 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 40) VDS a6249d4e-b23d-4a14-9f56-a0761d824721 was added to the Resource Manager >2014-10-05 15:12:29,513 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 40) Finished initializing ResourceManager >2014-10-05 15:12:29,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 40) Initialization of OvfDataUpdater completed successfully. >2014-10-05 15:12:29,525 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Start scheduling to enable vds load balancer >2014-10-05 15:12:29,525 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Finished scheduling to enable vds load balancer >2014-10-05 15:12:29,525 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Start HA Reservation check >2014-10-05 15:12:29,525 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Finished HA Reservation check >2014-10-05 15:12:29,545 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(570d6b67): Start initializing >2014-10-05 15:12:29,555 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 40) Init VM custom properties utilities >2014-10-05 15:12:29,555 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 40) Init device custom properties utilities >2014-10-05 15:12:29,562 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Initializing Scheduling manager >2014-10-05 15:12:29,582 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(570d6b67): Finished initializing. Available MACs in pool: 254 >2014-10-05 15:12:29,618 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) External scheduler disabled, discovery skipped >2014-10-05 15:12:29,618 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 40) Initialized Scheduling manager >2014-10-05 15:12:29,618 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 40) Initializing DWH Heart Beat >2014-10-05 15:12:29,624 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 40) DWH Heart Beat initialized >2014-10-05 15:12:30,086 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [2d357bfa] Running command: LogoutUserCommand internal: false. >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: UNASSIGNED not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-05 15:12:30,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-05 15:12:30,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-05 15:12:30,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: DWH_STOPPED not exist in string table >2014-10-05 15:12:30,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: DWH_STARTED not exist in string table >2014-10-05 15:12:30,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: DWH_ERROR not exist in string table >2014-10-05 15:12:30,131 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-10-05 15:12:30,131 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-10-05 15:12:30,131 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 15:12:30,131 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 15:12:30,131 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-10-05 15:12:30,133 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-10-05 15:12:30,133 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-10-05 15:12:30,133 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-10-05 15:12:30,133 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-10-05 15:12:30,133 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,134 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:12:30,187 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [2d357bfa] Correlation ID: 2d357bfa, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-05 15:12:33,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721]), log id: 238a3dd >2014-10-05 15:12:33,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: 2148282 >2014-10-05 15:12:33,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: 238a3dd >2014-10-05 15:12:33,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 2148282 >2014-10-05 15:12:33,224 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_2. >2014-10-05 15:12:33,235 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 15:12:33,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=78012759-feaf-418a-88bb-55527c8140c8, force=false, secondsToWait=0, gracefully=false), log id: 36b52bc9 >2014-10-05 15:12:33,471 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 >2014-10-05 15:12:33,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, DestroyVDSCommand, log id: 36b52bc9 >2014-10-05 15:12:33,490 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [4f3a9939] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 15:12:33,591 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down. Exit message: internal error Failed to acquire lock: error -243. >2014-10-05 15:12:33,597 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) VM HostedEngine (78012759-feaf-418a-88bb-55527c8140c8) is running in db and not running in VDS hosted_engine_2 >2014-10-05 15:12:33,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-7) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 42ce2265 >2014-10-05 15:12:33,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-7) FINISH, FullListVdsCommand, return: [], log id: 42ce2265 >2014-10-05 15:12:33,647 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Initializing Host: hosted_engine_2 >2014-10-05 15:12:33,650 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [5aced6b4] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 15:12:33,670 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-15) [436af6a] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:12:33,664 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-16) [11817ef3] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:12:36,659 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 30c8f50f >2014-10-05 15:12:36,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, displayIp=0, pauseCode=NOERR, display=vnc, pid=21150, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, clientIp=, vmId=78012759-feaf-418a-88bb-55527c8140c8, devices=[Ljava.lang.Object;@747b4874, vmName=HostedEngine, cpuType=Conroe}], log id: 30c8f50f >2014-10-05 15:12:36,709 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a console Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=console0, specParams={}, device=console, type=console, deviceId=c95bddaf-9b44-4e16-9de8-799acd0ee966} >2014-10-05 15:12:36,709 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a memballoon Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-10-05 15:12:36,710 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Empty or NULL values were passed for a VM 78012759-feaf-418a-88bb-55527c8140c8 device, Device is skipped >2014-10-05 15:12:39,547 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-20) [29569831] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 15:12:39,559 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-20) [29569831] Storage Pool 00000002-0002-0002-0002-000000000366 - Updating Storage Domain 12a6a966-7a3e-4fcb-94d2-4ff58271527d status from Active to Unknown, reason : null >2014-10-05 15:12:39,843 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-20) [29569831] Correlation ID: 29569831, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-05 15:12:39,886 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) [29569831] hostFromVds::selectedVds - hosted_engine_2, spmStatus SPM, storage pool Default >2014-10-05 15:12:39,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) [29569831] Initialize Irs proxy from vds: 10.35.64.85 >2014-10-05 15:12:39,901 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-20) [29569831] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: 10.35.64.85). >2014-10-05 15:12:39,995 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-30) [29569831] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false), log id: 77456aa4 >2014-10-05 15:12:40,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-30) [29569831] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000366 >2014-10-05 15:12:40,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-30) [29569831] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 2eeb1d6a >2014-10-05 15:12:40,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-30) [29569831] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2eeb1d6a >2014-10-05 15:12:40,050 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-30) [29569831] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 77456aa4 >2014-10-05 15:12:40,050 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-30) [29569831] Discovered no tasks on Storage Pool Default >2014-10-05 15:13:16,491 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 15:14:56,767 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-05 15:14:56,771 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-05 15:14:56,774 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-05 15:14:56,774 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-05 15:14:56,774 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-05 15:14:56,775 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-05 15:14:56,775 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-05 15:14:56,775 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-05 15:14:56,778 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-05 15:14:56,778 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-05 15:14:56,778 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-05 15:14:56,779 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_USER" is "engine". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_FQDN" is "hosted_test.qa.lab.tlv.redhat.com". >2014-10-05 15:14:56,780 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-05 15:14:56,781 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-05 15:14:56,782 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-05 15:14:56,782 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-05 15:14:56,782 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-05 15:14:56,786 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-10-05 15:14:56,787 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_USER" is "ovirt". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-05 15:14:56,788 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-05 15:14:59,523 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Start initializing Backend >2014-10-05 15:15:00,135 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 43) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-05 15:15:00,309 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Running ovirt-engine 3.4.3-1.1.el6ev >2014-10-05 15:15:00,310 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 43) Start initializing dictionaries >2014-10-05 15:15:00,314 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 43) Finished initializing dictionaries >2014-10-05 15:15:00,314 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Start initializing AuditLogCleanupManager >2014-10-05 15:15:00,315 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-05 15:15:00,353 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Finished initializing AuditLogCleanupManager >2014-10-05 15:15:00,356 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Start initializing TagsDirector >2014-10-05 15:15:00,368 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Tag root added to tree >2014-10-05 15:15:00,480 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Finished initializing TagsDirector >2014-10-05 15:15:00,486 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 43) Start initializing IsoDomainListSyncronizer >2014-10-05 15:15:00,491 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 43) Finished initializing IsoDomainListSyncronizer >2014-10-05 15:15:00,603 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Completed initializing handlers >2014-10-05 15:15:00,604 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Start initializing ErrorTranslatorImpl >2014-10-05 15:15:00,622 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-05 15:15:00,623 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Finished initializing ErrorTranslatorImpl >2014-10-05 15:15:00,623 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Start initializing ErrorTranslatorImpl >2014-10-05 15:15:00,623 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Finished initializing ErrorTranslatorImpl >2014-10-05 15:15:00,623 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Mark incomplete jobs as UNKNOWN >2014-10-05 15:15:00,693 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 43) Start initializing JobRepositoryCleanupManager >2014-10-05 15:15:00,694 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 43) Finished initializing JobRepositoryCleanupManager >2014-10-05 15:15:00,698 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 43) Start initializing AutoRecoveryManager >2014-10-05 15:15:00,709 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 43) Finished initializing AutoRecoveryManager >2014-10-05 15:15:00,713 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 43) Start initializing ExecutionMessageDirector >2014-10-05 15:15:00,715 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 43) Finished initializing ExecutionMessageDirector >2014-10-05 15:15:00,951 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Start initializing UsersDomainsCacheManagerService >2014-10-05 15:15:00,964 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Start initializing DbUserCacheManager >2014-10-05 15:15:00,965 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Finished initializing DbUserCacheManager >2014-10-05 15:15:00,965 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Finished initializing UsersDomainsCacheManagerService >2014-10-05 15:15:01,045 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 46) Initialization of AsyncTaskManager completed successfully. >2014-10-05 15:15:01,049 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 46) Start initializing ResourceManager >2014-10-05 15:15:01,426 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 46) Entered VdsManager constructor >2014-10-05 15:15:01,487 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 46) Initialize vdsBroker (10.35.97.36,54,321) >2014-10-05 15:15:01,732 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 46) VDS 25466fb3-6dfd-4f53-82ce-c622f4ab7726 was added to the Resource Manager >2014-10-05 15:15:01,732 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 46) Entered VdsManager constructor >2014-10-05 15:15:01,742 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 46) Initialize vdsBroker (10.35.64.85,54,321) >2014-10-05 15:15:01,751 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 46) VDS a6249d4e-b23d-4a14-9f56-a0761d824721 was added to the Resource Manager >2014-10-05 15:15:01,788 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 46) Finished initializing ResourceManager >2014-10-05 15:15:01,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 46) Initialization of OvfDataUpdater completed successfully. >2014-10-05 15:15:01,799 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Start scheduling to enable vds load balancer >2014-10-05 15:15:01,799 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Finished scheduling to enable vds load balancer >2014-10-05 15:15:01,799 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Start HA Reservation check >2014-10-05 15:15:01,799 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Finished HA Reservation check >2014-10-05 15:15:01,824 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(3f6f1dae): Start initializing >2014-10-05 15:15:01,832 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 46) Init VM custom properties utilities >2014-10-05 15:15:01,833 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 46) Init device custom properties utilities >2014-10-05 15:15:01,846 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Initializing Scheduling manager >2014-10-05 15:15:01,863 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(3f6f1dae): Finished initializing. Available MACs in pool: 254 >2014-10-05 15:15:01,896 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) External scheduler disabled, discovery skipped >2014-10-05 15:15:01,896 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 46) Initialized Scheduling manager >2014-10-05 15:15:01,897 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 46) Initializing DWH Heart Beat >2014-10-05 15:15:01,898 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 46) DWH Heart Beat initialized >2014-10-05 15:15:05,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726]), log id: bc833ab >2014-10-05 15:15:06,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: bc833ab >2014-10-05 15:15:06,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721]), log id: ccfb677 >2014-10-05 15:15:06,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GetHardwareInfoVDSCommand, log id: ccfb677 >2014-10-05 15:15:06,193 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: UNASSIGNED not exist in string table >2014-10-05 15:15:06,193 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-10-05 15:15:06,193 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-10-05 15:15:06,193 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-10-05 15:15:06,193 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-05 15:15:06,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-05 15:15:06,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-05 15:15:06,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-05 15:15:06,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-05 15:15:06,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: DWH_STOPPED not exist in string table >2014-10-05 15:15:06,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: DWH_STARTED not exist in string table >2014-10-05 15:15:06,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: DWH_ERROR not exist in string table >2014-10-05 15:15:06,203 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-10-05 15:15:06,203 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-10-05 15:15:06,203 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-10-05 15:15:06,204 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,205 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-10-05 15:15:06,354 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_1. >2014-10-05 15:15:06,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host hosted_engine_2. >2014-10-05 15:15:06,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=78012759-feaf-418a-88bb-55527c8140c8, force=false, secondsToWait=0, gracefully=false), log id: c57dd6b >2014-10-05 15:15:06,492 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, DestroyVDSCommand, log id: c57dd6b >2014-10-05 15:15:06,524 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-8) RefreshVmList vm id 78012759-feaf-418a-88bb-55527c8140c8 status = PoweringUp on vds hosted_engine_2 ignoring it in the refresh until migration is done >2014-10-05 15:15:06,669 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down. Exit message: internal error Failed to acquire lock: error -243. >2014-10-05 15:15:06,671 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) VM HostedEngine (78012759-feaf-418a-88bb-55527c8140c8) is running in db and not running in VDS hosted_engine_1 >2014-10-05 15:15:06,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-7) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 16965218 >2014-10-05 15:15:06,689 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-8) Initializing Host: hosted_engine_2 >2014-10-05 15:15:06,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-7) FINISH, FullListVdsCommand, return: [], log id: 16965218 >2014-10-05 15:15:06,834 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Initializing Host: hosted_engine_1 >2014-10-05 15:15:06,955 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-12) [5794636b] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:15:06,958 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-8) [734aad5f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: a6249d4e-b23d-4a14-9f56-a0761d824721 Type: VDS >2014-10-05 15:15:06,961 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [9ecd3c9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 25466fb3-6dfd-4f53-82ce-c622f4ab7726 Type: VDS >2014-10-05 15:15:07,045 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-14) [942a4cb] Running command: ProcessDownVmCommand internal: true. >2014-10-05 15:15:10,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[78012759-feaf-418a-88bb-55527c8140c8]), log id: 8f18a20 >2014-10-05 15:15:10,444 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, memSize=4096, nicModel=rtl8139,pv, smp=2, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, displayIp=0, pauseCode=NOERR, display=vnc, pid=14739, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, clientIp=, vmId=78012759-feaf-418a-88bb-55527c8140c8, devices=[Ljava.lang.Object;@36d4423d, vmName=HostedEngine, cpuType=Conroe}], log id: 8f18a20 >2014-10-05 15:15:10,460 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Received a console Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=console0, specParams={}, device=console, type=console, deviceId=c95bddaf-9b44-4e16-9de8-799acd0ee966} >2014-10-05 15:15:10,460 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Received a memballoon Device without an address when processing VM 78012759-feaf-418a-88bb-55527c8140c8 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-10-05 15:15:10,460 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Empty or NULL values were passed for a VM 78012759-feaf-418a-88bb-55527c8140c8 device, Device is skipped >2014-10-05 15:15:11,845 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-21) [a170d9d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000366 Type: StoragePool >2014-10-05 15:15:11,871 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-21) [a170d9d] Storage Pool 00000002-0002-0002-0002-000000000366 - Updating Storage Domain 12a6a966-7a3e-4fcb-94d2-4ff58271527d status from Active to Unknown, reason : null >2014-10-05 15:15:12,156 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [a170d9d] Correlation ID: a170d9d, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-05 15:15:12,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-21) [a170d9d] hostFromVds::selectedVds - hosted_engine_2, spmStatus SPM, storage pool Default >2014-10-05 15:15:12,236 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-21) [a170d9d] Initialize Irs proxy from vds: 10.35.64.85 >2014-10-05 15:15:12,246 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [a170d9d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: 10.35.64.85). >2014-10-05 15:15:12,356 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [a170d9d] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000366, ignoreFailoverLimit = false), log id: d867f36 >2014-10-05 15:15:12,424 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [a170d9d] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000366 >2014-10-05 15:15:12,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [a170d9d] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721), log id: 2abfaea >2014-10-05 15:15:12,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [a170d9d] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2abfaea >2014-10-05 15:15:12,448 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [a170d9d] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: d867f36 >2014-10-05 15:15:12,449 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-25) [a170d9d] Discovered no tasks on Storage Pool Default >2014-10-05 15:15:13,591 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) VM HostedEngine 78012759-feaf-418a-88bb-55527c8140c8 moved from PoweringUp --> Up >2014-10-05 16:15:01,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-10-05 16:15:01,802 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VM OVFs in Data Center Default >2014-10-05 16:15:01,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated VM OVFs in Data Center Default >2014-10-05 16:15:01,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update template OVFs in Data Center Default >2014-10-05 16:15:01,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated templates OVFs in Data Center Default >2014-10-05 16:15:01,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-10-05 16:15:01,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully removed unneeded template/vm OVFs in Data Center Default >2014-10-05 16:27:37,024 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-3) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-10-05 16:27:37,050 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-3) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-10-05 16:27:41,504 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginAdminUserCommand internal: false. >2014-10-05 16:27:41,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-05 16:27:42,071 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-2) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-10-05 16:27:43,486 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginUserCommand internal: false. >2014-10-05 16:28:04,265 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-05 16:28:04,265 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-20) [2cdd4f56] Start running CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 16:28:04,265 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Start running CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 16:28:04,292 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-20) [2cdd4f56] Lock Acquired to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 16:28:04,296 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Lock Acquired to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 16:28:04,405 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] START, IsVmDuringInitiatingVDSCommand( vmId = efe2c68c-1a43-4965-8419-884d13f0dda8), log id: 28694360 >2014-10-05 16:28:04,405 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 28694360 >2014-10-05 16:28:04,406 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-20) [2cdd4f56] START, IsVmDuringInitiatingVDSCommand( vmId = f2dcdf0d-59ef-467e-a803-ac0002baa9ae), log id: 2d88b7f1 >2014-10-05 16:28:04,411 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-20) [2cdd4f56] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2d88b7f1 >2014-10-05 16:28:04,568 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-20) [2cdd4f56] Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2014-10-05 16:28:04,569 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2014-10-05 16:28:04,692 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] Running command: RunVmCommand internal: false. Entities affected : ID: f2dcdf0d-59ef-467e-a803-ac0002baa9ae Type: VM >2014-10-05 16:28:04,716 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] Started HA reservation scoring method >2014-10-05 16:28:04,769 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] START, CreateVmVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 7bdb09c >2014-10-05 16:28:04,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] START, CreateVDSCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, vm=VM [test_affinity_1]), log id: 4d3704c7 >2014-10-05 16:28:05,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=998aa484-8ea5-4a0f-875f-3840eb8f6f31}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e743e822-fcb8-4771-836c-58d47e531c2c}, {shared=false, index=0, volumeID=1c4a67d1-bb48-4298-8e6d-982cac570b9c, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=e3455527-bada-4b75-b50b-09b6922833da, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=e3455527-bada-4b75-b50b-09b6922833da}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:99, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=8b955553-2d32-4f94-9885-1035a09df886}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=86973c30-191a-4c9c-aee8-3cf40e5f0bcc}],acpiEnable=true,vmName=test_affinity_1,cpuType=Conroe,custom={device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d65be4e0-89ba-41ac-907c-4e0c62f29444, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=6ec753ab-5911-4fb5-a0d9-3cea95c0df24, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444device_1b015b4e-8618-4e3d-85c6-9a8391db50c3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1b015b4e-8618-4e3d-85c6-9a8391db50c3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e4312e31-c19a-4136-a269-24e2aec5d9a9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-10-05 16:28:05,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] FINISH, CreateVDSCommand, log id: 4d3704c7 >2014-10-05 16:28:05,726 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7bdb09c >2014-10-05 16:28:05,726 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] Lock freed to object EngineLock [exclusiveLocks= key: f2dcdf0d-59ef-467e-a803-ac0002baa9ae value: VM >, sharedLocks= ] >2014-10-05 16:28:05,753 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [2cdd4f56] Correlation ID: 2cdd4f56, Job ID: 2203e8f4-af80-484f-a29f-6153fb9aad4f, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 was started by admin (Host: hosted_engine_1). >2014-10-05 16:28:05,812 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Running command: RunVmCommand internal: false. Entities affected : ID: efe2c68c-1a43-4965-8419-884d13f0dda8 Type: VM >2014-10-05 16:28:11,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-71) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 195e2797 >2014-10-05 16:28:12,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-71) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d65be4e0-89ba-41ac-907c-4e0c62f29444, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=6ec753ab-5911-4fb5-a0d9-3cea95c0df24, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444device_1b015b4e-8618-4e3d-85c6-9a8391db50c3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1b015b4e-8618-4e3d-85c6-9a8391db50c3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e4312e31-c19a-4136-a269-24e2aec5d9a9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=-1, smp=1, emulatedMachine=rhel6.5.0, status=WaitForLaunch, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=0, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@842ed3e, vmName=test_affinity_1, cpuType=Conroe}], log id: 195e2797 >2014-10-05 16:28:12,048 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) Received a memballoon Device without an address when processing VM f2dcdf0d-59ef-467e-a803-ac0002baa9ae devices, skipping device: {specParams={model=virtio}, target=15360000, device=memballoon, type=balloon, deviceId=b17ce5a6-adb9-4052-b0ac-fd3c6b988b16} >2014-10-05 16:28:15,826 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Candidate host hosted_engine_1 (25466fb3-6dfd-4f53-82ce-c622f4ab7726) was filtered out by VAR__FILTERTYPE__INTERNAL filter Memory (correlation id: 7ed568b6) >2014-10-05 16:28:15,848 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 55f8ecd >2014-10-05 16:28:15,853 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] START, CreateVDSCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, vm=VM [test_affinity_2]), log id: 6752e108 >2014-10-05 16:28:16,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=15000,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=15000,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=efe2c68c-1a43-4965-8419-884d13f0dda8,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=f04587da-d4ad-4ff7-bc66-02bcc71ea043}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=d78f2fe2-f412-4ffc-aa11-787ce5f79dcb}, {shared=false, index=0, volumeID=b1d5b60f-5b16-4960-8206-82e7211288a8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=12a6a966-7a3e-4fcb-94d2-4ff58271527d, imageID=4e31448a-d9e6-4fb1-900d-8c278483aa80, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000366, readonly=false, deviceId=4e31448a-d9e6-4fb1-900d-8c278483aa80}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:5d:65:98, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=10dd6dcb-658f-4b26-ac87-df06df5f5caa}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=e58be4d8-2411-43be-ba0e-81f04d9a4f85}],acpiEnable=true,vmName=test_affinity_2,cpuType=Conroe,custom={device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1f2f2858-bb25-4fa8-b621-90b348713220, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=5a778c17-c2af-4c1a-b0ac-db8d037779a4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=9b9ebcdd-4833-4d25-89fd-062d99da87c3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b3c90b2a-0447-4a1a-80d1-7085dfc13bc5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220device_f835ff24-09c6-42f0-8727-ed73ff322029=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=f835ff24-09c6-42f0-8727-ed73ff322029, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-10-05 16:28:16,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] FINISH, CreateVDSCommand, log id: 6752e108 >2014-10-05 16:28:16,612 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 55f8ecd >2014-10-05 16:28:16,612 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Lock freed to object EngineLock [exclusiveLocks= key: efe2c68c-1a43-4965-8419-884d13f0dda8 value: VM >, sharedLocks= ] >2014-10-05 16:28:16,625 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [7ed568b6] Correlation ID: 7ed568b6, Job ID: bd14e30e-c708-4a5a-aa87-a036e2c2e5f3, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 was started by admin (Host: hosted_engine_2). >2014-10-05 16:28:30,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 14d0ef94 >2014-10-05 16:28:30,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1f2f2858-bb25-4fa8-b621-90b348713220, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=5a778c17-c2af-4c1a-b0ac-db8d037779a4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=9b9ebcdd-4833-4d25-89fd-062d99da87c3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b3c90b2a-0447-4a1a-80d1-7085dfc13bc5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220device_f835ff24-09c6-42f0-8727-ed73ff322029=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=f835ff24-09c6-42f0-8727-ed73ff322029, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=-1, smp=1, emulatedMachine=rhel6.5.0, status=WaitForLaunch, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=0, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@2120e839, vmName=test_affinity_2, cpuType=Conroe}], log id: 14d0ef94 >2014-10-05 16:28:30,626 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a memballoon Device without an address when processing VM efe2c68c-1a43-4965-8419-884d13f0dda8 devices, skipping device: {specParams={model=virtio}, target=15360000, device=memballoon, type=balloon, deviceId=2fb495eb-c0d0-4292-9dc6-a8665246f9a2} >2014-10-05 16:28:42,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = 25466fb3-6dfd-4f53-82ce-c622f4ab7726, vds=Host[hosted_engine_1,25466fb3-6dfd-4f53-82ce-c622f4ab7726], vmIds=[f2dcdf0d-59ef-467e-a803-ac0002baa9ae]), log id: 37126565 >2014-10-05 16:28:42,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, acpiEnable=true, custom={device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=d65be4e0-89ba-41ac-907c-4e0c62f29444, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=6ec753ab-5911-4fb5-a0d9-3cea95c0df24, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9device_d65be4e0-89ba-41ac-907c-4e0c62f29444device_1b015b4e-8618-4e3d-85c6-9a8391db50c3=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=1b015b4e-8618-4e3d-85c6-9a8391db50c3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1e5a09d5-1bb1-4e43-be0c-62d9a7e48c3adevice_6ec753ab-5911-4fb5-a0d9-3cea95c0df24device_e4312e31-c19a-4136-a269-24e2aec5d9a9=VmDevice {vmId=f2dcdf0d-59ef-467e-a803-ac0002baa9ae, deviceId=e4312e31-c19a-4136-a269-24e2aec5d9a9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=19749, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6323a101, vmName=test_affinity_1, cpuType=Conroe}], log id: 37126565 >2014-10-05 16:28:46,098 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from WaitForLaunch --> PoweringUp >2014-10-05 16:28:46,133 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from WaitForLaunch --> PoweringUp >2014-10-05 16:28:46,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = a6249d4e-b23d-4a14-9f56-a0761d824721, vds=Host[hosted_engine_2,a6249d4e-b23d-4a14-9f56-a0761d824721], vmIds=[efe2c68c-1a43-4965-8419-884d13f0dda8]), log id: 171d9f2a >2014-10-05 16:28:46,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [{displaySecurePort=5902, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, acpiEnable=true, custom={device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=1f2f2858-bb25-4fa8-b621-90b348713220, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=5a778c17-c2af-4c1a-b0ac-db8d037779a4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=9b9ebcdd-4833-4d25-89fd-062d99da87c3, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=b3c90b2a-0447-4a1a-80d1-7085dfc13bc5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_b3c90b2a-0447-4a1a-80d1-7085dfc13bc5device_9b9ebcdd-4833-4d25-89fd-062d99da87c3device_5a778c17-c2af-4c1a-b0ac-db8d037779a4device_1f2f2858-bb25-4fa8-b621-90b348713220device_f835ff24-09c6-42f0-8727-ed73ff322029=VmDevice {vmId=efe2c68c-1a43-4965-8419-884d13f0dda8, deviceId=f835ff24-09c6-42f0-8727-ed73ff322029, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=15000, displayPort=5901, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=15000, display=qxl, pid=14010, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6bad4277, vmName=test_affinity_2, cpuType=Conroe}], log id: 171d9f2a >2014-10-05 16:29:07,830 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) VM test_affinity_1 f2dcdf0d-59ef-467e-a803-ac0002baa9ae moved from PoweringUp --> Up >2014-10-05 16:29:07,842 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) Correlation ID: 2cdd4f56, Job ID: 2203e8f4-af80-484f-a29f-6153fb9aad4f, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_1 started on Host hosted_engine_1 >2014-10-05 16:29:17,294 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) VM test_affinity_2 efe2c68c-1a43-4965-8419-884d13f0dda8 moved from PoweringUp --> Up >2014-10-05 16:29:17,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: 7ed568b6, Job ID: bd14e30e-c708-4a5a-aa87-a036e2c2e5f3, Call Stack: null, Custom Event ID: -1, Message: VM test_affinity_2 started on Host hosted_engine_2
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1149496
: 944042