Attachment 910299 Details for Bug 1111086 – ovirt-engine.log

ovirt-engine.log

ovirt-engine.log (text/plain), 140.01 KB, created by cshao on 2014-06-19 08:30:23 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: cshao

Created: 2014-06-19 08:30:23 UTC

Size: 140.01 KB

patch

obsolete

>ctor.java:64) [mina-core.jar:]
>	at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:511) [mina-core.jar:]
>	at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:]
>	... 3 more
>
>2014-06-19 14:33:02,838 INFO  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-16) [3faa0ad2] Lock Acquired to object EngineLock [exclusiveLocks= key: 84308a71-7b29-4527-acad-779254935438 value: VDS_FENCE
>, sharedLocks= ]
>2014-06-19 14:33:02,916 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-16) [3faa0ad2] Failed to run Fence script on vds:dell-pet105-02.qe.lab.eng.nay.redhat.com, VMs moved to UnKnown instead.
>2014-06-19 14:33:02,968 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [3faa0ad2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-pet105-02.qe.lab.eng.nay.redhat.com became non responsive. It has no power management configured. Please check the host status, manually reboot it, and click "Confirm Host Has Been Rebooted"
>2014-06-19 14:33:02,968 WARN  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-16) [3faa0ad2] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VAR__ACTION__RESTART,VDS_FENCE_DISABLED
>2014-06-19 14:33:02,968 INFO  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-16) [3faa0ad2] Lock freed to object EngineLock [exclusiveLocks= key: 84308a71-7b29-4527-acad-779254935438 value: VDS_FENCE
>, sharedLocks= ]
>2014-06-19 14:33:30,436 INFO  [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp-/127.0.0.1:8702-4) [5d299f68] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected :  ID: aaa00000-0000-0000-0000-123456789aaa Type: System
>2014-06-19 14:33:30,515 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [5d299f68] Correlation ID: 5d299f68, Call Stack: null, Custom Event ID: -1, Message: Data Center hadongupgrade1, Compatibility Version 3.3 and Quota Type DISABLED was added by admin
>2014-06-19 14:33:38,711 INFO  [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-5) [7db7ef0e] Running command: AddVdsGroupCommand internal: false. Entities affected :  ID: 21be17d7-5769-4c9e-8071-ef9f25a99439 Type: StoragePool
>2014-06-19 14:33:38,756 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [7db7ef0e] Correlation ID: 7db7ef0e, Call Stack: null, Custom Event ID: -1, Message: Cluster hadongclus1 was added by admin
>2014-06-19 14:34:13,505 INFO  [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-2) Registration request: source='10.66.9.184', secured='true', address='10.66.9.184', vdsPort=54321, name='dhcp-9-184.nay.redhat.com', uniqueId='4C4C4544-0054-4D10-8038-C6C04F353358_78:2b:cb:9a:72:a3'
>2014-06-19 14:34:13,514 INFO  [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-2) Running Command: RegisterVds
>2014-06-19 14:34:13,671 INFO  [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-2) [7c4c9171] Running command: AddVdsCommand internal: true. Entities affected :  ID: 00000001-0001-0001-0001-000000000111 Type: VdsGroups
>2014-06-19 14:34:13,865 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-2) [6117c809] Running command: AddVdsSpmIdCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:34:13,901 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-2) [6117c809] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000035f value: REGISTER_VDS
>, sharedLocks= ]
>2014-06-19 14:34:13,904 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] START, RemoveVdsVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: 13c0dbeb
>2014-06-19 14:34:13,904 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] FINISH, RemoveVdsVDSCommand, log id: 13c0dbeb
>2014-06-19 14:34:13,908 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] START, AddVdsVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: c296ccc
>2014-06-19 14:34:13,908 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] AddVds - entered , starting logic to add VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a
>2014-06-19 14:34:13,912 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] AddVds - VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a was added, will try to add it to the resource manager
>2014-06-19 14:34:13,912 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-2) [6117c809] Entered VdsManager constructor
>2014-06-19 14:34:13,934 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-2) [6117c809] Initialize vdsBroker (10.66.9.184,54,321)
>2014-06-19 14:34:13,935 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-2) [6117c809] VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a was added to the Resource Manager
>2014-06-19 14:34:13,935 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-2) [6117c809] FINISH, AddVdsVDSCommand, log id: c296ccc
>2014-06-19 14:34:13,962 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6117c809] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:34:14,001 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6117c809] Correlation ID: 7c4c9171, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was added by Non interactive user.
>2014-06-19 14:34:14,001 INFO  [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-2) [6117c809] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: dhcp-9-184.nay.redhat.com, Hostname: 10.66.9.184, UniqueID: 4C4C4544-0054-4D10-8038-C6C04F353358
>2014-06-19 14:34:14,019 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6117c809] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com registered.
>2014-06-19 14:34:27,727 INFO  [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf.
>2014-06-19 14:34:28,558 INFO  [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-5) [457cbf49] Running command: LogoutUserCommand internal: false.
>2014-06-19 14:34:28,600 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [457cbf49] Correlation ID: 457cbf49, Call Stack: null, Custom Event ID: -1, Message: User admin logged out.
>2014-06-19 14:34:39,912 INFO  [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-8) [47447455] Running command: ChangeVDSClusterCommand internal: false. Entities affected :  ID: f7827b32-fc82-4bdc-bf47-a4d7886a0d00 Type: VdsGroups
>2014-06-19 14:34:39,942 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] START, RemoveVdsVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: 7b324def
>2014-06-19 14:34:39,942 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [47447455] vdsManager::disposing
>2014-06-19 14:34:39,943 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] FINISH, RemoveVdsVDSCommand, log id: 7b324def
>2014-06-19 14:34:39,945 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] START, AddVdsVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: a64095e
>2014-06-19 14:34:39,945 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] AddVds - entered , starting logic to add VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a
>2014-06-19 14:34:39,947 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] AddVds - VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a was added, will try to add it to the resource manager
>2014-06-19 14:34:39,947 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [47447455] Entered VdsManager constructor
>2014-06-19 14:34:39,966 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [47447455] Initialize vdsBroker (10.66.9.184,54,321)
>2014-06-19 14:34:39,966 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-8) [47447455] VDS f4cd046f-4623-40d7-8cdc-1a4188cd5a9a was added to the Resource Manager
>2014-06-19 14:34:39,966 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [47447455] FINISH, AddVdsVDSCommand, log id: a64095e
>2014-06-19 14:34:39,993 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [3056ced9] Running command: AddVdsSpmIdCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:34:40,056 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [3056ced9] Lock freed to object EngineLock [exclusiveLocks= key: 21be17d7-5769-4c9e-8071-ef9f25a99439 value: REGISTER_VDS
>, sharedLocks= ]
>2014-06-19 14:34:40,076 INFO  [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-5) [41c31d87] Running command: PersistentSetupNetworksCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:34:40,083 WARN  [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-5) [41c31d87] CanDoAction of action SetupNetworks failed. Reasons:VAR__ACTION__SETUP,VAR__TYPE__NETWORKS,VAR__HOST_STATUS__UP_MAINTENANCE_OR_NON_OPERATIONAL,ACTION_TYPE_FAILED_VDS_STATUS_ILLEGAL
>2014-06-19 14:34:40,105 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [3056ced9] Correlation ID: 47447455, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:34:40,160 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:34:40,160 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:34:40,160 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-3) [28687f20] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:34:40,205 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:34:40,205 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:34:40,246 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [28687f20] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:34:40,281 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [28687f20] Correlation ID: 28687f20, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:34:40,562 INFO  [org.ovirt.engine.core.bll.ApproveVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Running command: ApproveVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:34:40,562 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Before Installation host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com
>2014-06-19 14:34:40,604 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5ba2177e
>2014-06-19 14:34:40,638 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] FINISH, SetVdsStatusVDSCommand, log id: 5ba2177e
>2014-06-19 14:34:40,813 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Installation 10.66.9.184: Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13
>2014-06-19 14:34:40,839 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13.
>2014-06-19 14:34:40,878 INFO  [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Installation of 10.66.9.184. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar
>2014-06-19 14:34:40,887 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-4) SSH execute root@10.66.9.184 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x &&  "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True'
>2014-06-19 14:34:41,509 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Initializing
>2014-06-19 14:34:41,530 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Initializing.
>2014-06-19 14:34:41,543 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Environment setup
>2014-06-19 14:34:41,563 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Environment setup.
>2014-06-19 14:34:41,563 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Environment packages setup
>2014-06-19 14:34:41,582 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Environment packages setup.
>2014-06-19 14:34:41,582 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Programs detection
>2014-06-19 14:34:41,597 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Programs detection.
>2014-06-19 14:34:41,597 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Environment customization
>2014-06-19 14:34:41,614 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Environment customization.
>2014-06-19 14:34:41,623 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Host is hypervisor
>2014-06-19 14:34:41,646 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Host is hypervisor.
>2014-06-19 14:34:41,669 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Logs at host located at: '/tmp/ovirt-host-deploy-20140619063441.log'
>2014-06-19 14:34:41,697 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20140619063441.log'.
>2014-06-19 14:34:41,759 INFO  [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.9.184 reports unique id 4C4C4544-0054-4D10-8038-C6C04F353358
>2014-06-19 14:34:41,762 INFO  [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0054-4D10-8038-C6C04F353358 to Host 10.66.9.184
>2014-06-19 14:34:41,873 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Setup validation
>2014-06-19 14:34:41,889 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Setup validation.
>2014-06-19 14:34:41,913 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Hardware supports virtualization
>2014-06-19 14:34:41,931 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Hardware supports virtualization.
>2014-06-19 14:34:41,931 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Transaction setup
>2014-06-19 14:34:41,956 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Transaction setup.
>2014-06-19 14:34:41,956 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Misc configuration
>2014-06-19 14:34:41,972 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Misc configuration.
>2014-06-19 14:34:41,972 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Package installation
>2014-06-19 14:34:41,988 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Package installation.
>2014-06-19 14:34:42,272 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Misc configuration
>2014-06-19 14:34:42,289 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Misc configuration.
>2014-06-19 14:34:42,305 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Setting time
>2014-06-19 14:34:42,341 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Setting time.
>2014-06-19 14:34:42,970 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Initializing Host: dhcp-9-184.nay.redhat.com
>2014-06-19 14:34:43,983 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Enrolling certificate
>2014-06-19 14:34:44,005 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Enrolling certificate.
>2014-06-19 14:34:45,179 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Transaction commit
>2014-06-19 14:34:45,205 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Transaction commit.
>2014-06-19 14:34:45,205 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stage: Closing up
>2014-06-19 14:34:45,239 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stage: Closing up.
>2014-06-19 14:34:50,275 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Stopping libvirtd
>2014-06-19 14:34:50,296 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Stopping libvirtd.
>2014-06-19 14:34:50,495 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Starting vdsm
>2014-06-19 14:34:50,538 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Starting vdsm.
>2014-06-19 14:35:01,426 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.9.184: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140619143501-10.66.9.184-7ffcda97.log'
>2014-06-19 14:35:01,445 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ffcda97, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140619143501-10.66.9.184-7ffcda97.log'.
>2014-06-19 14:35:01,586 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
>2014-06-19 14:35:01,588 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Command PollVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
>2014-06-19 14:35:02,093 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
>2014-06-19 14:35:02,095 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Command PollVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
>2014-06-19 14:35:02,667 INFO  [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Engine managed to communicate with VDSM agent on host dhcp-9-184.nay.redhat.com
>2014-06-19 14:35:03,046 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 714f3e07
>2014-06-19 14:35:03,077 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] FINISH, SetVdsStatusVDSCommand, log id: 714f3e07
>2014-06-19 14:35:03,077 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] After Installation host dhcp-9-184.nay.redhat.com, oVirtNode
>2014-06-19 14:35:03,083 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3932a11c
>2014-06-19 14:35:03,118 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] FINISH, SetVdsStatusVDSCommand, log id: 3932a11c
>2014-06-19 14:35:03,143 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [7ffcda97] Correlation ID: 7ffcda97, Job ID: 51ec6cab-0111-45ac-9515-abcd4c7cd54a, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was successfully approved by user admin.
>2014-06-19 14:35:04,151 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GetHardwareInfoVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, vds=Host[dhcp-9-184.nay.redhat.com,f4cd046f-4623-40d7-8cdc-1a4188cd5a9a]), log id: 24343d84
>2014-06-19 14:35:04,237 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GetHardwareInfoVDSCommand, log id: 24343d84
>2014-06-19 14:35:04,306 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-70) [504b643f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:04,477 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) [504b643f] START, GetHardwareInfoVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, vds=Host[dhcp-9-184.nay.redhat.com,f4cd046f-4623-40d7-8cdc-1a4188cd5a9a]), log id: 129b09d5
>2014-06-19 14:35:04,550 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-70) [504b643f] FINISH, GetHardwareInfoVDSCommand, log id: 129b09d5
>2014-06-19 14:35:04,619 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) [504b643f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:35:04,666 INFO  [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-70) [28713b16] Running command: InitVdsOnUpCommand internal: true. Entities affected :  ID: 21be17d7-5769-4c9e-8071-ef9f25a99439 Type: StoragePool
>2014-06-19 14:35:04,688 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-70) [28713b16] START, SetMOMPolicyParametersVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: 332338d7
>2014-06-19 14:35:04,798 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-70) [28713b16] FINISH, SetMOMPolicyParametersVDSCommand, log id: 332338d7
>2014-06-19 14:35:04,809 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) [28713b16] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:35:04,845 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-70) [3edd9f8] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:04,853 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-70) [547e991d] Running command: HandleVdsVersionCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:12,134 INFO  [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-3) [4ccfe3ac] Lock Acquired to object EngineLock [exclusiveLocks= key: 84308a71-7b29-4527-acad-779254935438 value: VDS
>, sharedLocks= ]
>2014-06-19 14:35:12,145 INFO  [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] Running command: RemoveVdsCommand internal: false. Entities affected :  ID: 84308a71-7b29-4527-acad-779254935438 Type: VDS
>2014-06-19 14:35:12,247 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] START, RemoveVdsVDSCommand( HostId = 84308a71-7b29-4527-acad-779254935438), log id: 74a37c33
>2014-06-19 14:35:12,247 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] vdsManager::disposing
>2014-06-19 14:35:12,248 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] FINISH, RemoveVdsVDSCommand, log id: 74a37c33
>2014-06-19 14:35:12,269 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] Correlation ID: 4ccfe3ac, Call Stack: null, Custom Event ID: -1, Message: Host dell-pet105-02.qe.lab.eng.nay.redhat.com was removed by admin.
>2014-06-19 14:35:12,269 INFO  [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfe3ac] Lock freed to object EngineLock [exclusiveLocks= key: 84308a71-7b29-4527-acad-779254935438 value: VDS
>, sharedLocks= ]
>2014-06-19 14:35:36,305 INFO  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-37) [13c72e5a] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:36,308 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) [13c72e5a] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 7d51012f
>2014-06-19 14:35:36,333 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) [13c72e5a] FINISH, SetVdsStatusVDSCommand, log id: 7d51012f
>2014-06-19 14:35:36,466 INFO  [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-37) [13c72e5a] Running command: MaintenanceVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:36,491 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [13c72e5a] Correlation ID: 13c72e5a, Job ID: 4dacc2af-c30f-4026-ada1-c894ba914fd6, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was switched to Maintenance mode by admin.
>2014-06-19 14:35:38,912 INFO  [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) [2ea2bc57] Updated vds status from Preparing for Maintenance to Maintenance in database,  vds = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a : dhcp-9-184.nay.redhat.com
>2014-06-19 14:35:51,845 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:35:51,845 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:35:51,845 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-9) [27e91e66] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:51,888 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:35:51,888 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:35:51,888 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-9) [27e91e66] Lock Acquired to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:35:51,896 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Running command: InstallVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:35:51,896 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Execute upgrade host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com
>2014-06-19 14:35:51,899 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 206efd64
>2014-06-19 14:35:51,941 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [27e91e66] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:35:51,948 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] FINISH, SetVdsStatusVDSCommand, log id: 206efd64
>2014-06-19 14:35:51,981 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [27e91e66] Correlation ID: 27e91e66, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:35:52,168 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Installation 10.66.9.184: Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13
>2014-06-19 14:35:52,198 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Correlation ID: 27e91e66, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13.
>2014-06-19 14:35:52,235 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Installation 10.66.9.184: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso
>2014-06-19 14:35:52,273 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Correlation ID: 27e91e66, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso.
>2014-06-19 14:35:52,273 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-29) SSH execute root@10.66.9.184 'mkdir -p '/data/updates''
>2014-06-19 14:36:23,045 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-38) [13daca56] Timeout during node 10.66.8.153 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.8.153'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:36:23,046 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-38) [13daca56] Installation 10.66.8.153: Processing stopped due to timeout
>2014-06-19 14:36:23,102 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [13daca56] Correlation ID: 13daca56, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host dhcp-8-153.nay.redhat.com. Processing stopped due to timeout.
>2014-06-19 14:36:23,103 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-38) [13daca56] Host installation failed for host be0af7ef-2efb-492d-bcd8-e6dff09a5805, dhcp-8-153.nay.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.8.153'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:36:23,106 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-38) [13daca56] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1180acb0
>2014-06-19 14:36:23,136 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-38) [13daca56] FINISH, SetVdsStatusVDSCommand, log id: 1180acb0
>2014-06-19 14:36:23,160 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [13daca56] Correlation ID: 13daca56, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-8-153.nay.redhat.com installation failed. SSH session timeout host 'root@10.66.8.153'.
>2014-06-19 14:36:23,160 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-38) [13daca56] Lock freed to object EngineLock [exclusiveLocks= key: be0af7ef-2efb-492d-bcd8-e6dff09a5805 value: VDS
>, sharedLocks= ]
>2014-06-19 14:37:18,686 WARN  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-3) [77a8de48] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL
>2014-06-19 14:37:41,956 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:37:41,956 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:37:41,956 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-7) [61f2d546] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 14:37:41,984 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:37:41,984 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:37:41,988 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-7) [61f2d546] Lock Acquired to object EngineLock [exclusiveLocks= key: be0af7ef-2efb-492d-bcd8-e6dff09a5805 value: VDS
>, sharedLocks= ]
>2014-06-19 14:37:41,994 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Running command: InstallVdsCommand internal: true. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 14:37:41,994 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Execute upgrade host be0af7ef-2efb-492d-bcd8-e6dff09a5805, dhcp-8-153.nay.redhat.com
>2014-06-19 14:37:41,997 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1fa7a1b3
>2014-06-19 14:37:42,033 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [61f2d546] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-8-153.nay.redhat.com.
>2014-06-19 14:37:42,067 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] FINISH, SetVdsStatusVDSCommand, log id: 1fa7a1b3
>2014-06-19 14:37:42,092 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [61f2d546] Correlation ID: 61f2d546, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-8-153.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:37:42,279 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Installation 10.66.8.153: Connected to host 10.66.8.153 with SSH key fingerprint: d7:f9:e1:06:59:c0:04:c8:0d:8f:a8:e6:72:01:1a:e7
>2014-06-19 14:37:42,332 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Correlation ID: 61f2d546, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Connected to host 10.66.8.153 with SSH key fingerprint: d7:f9:e1:06:59:c0:04:c8:0d:8f:a8:e6:72:01:1a:e7.
>2014-06-19 14:37:42,378 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Installation 10.66.8.153: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso
>2014-06-19 14:37:42,399 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Correlation ID: 61f2d546, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso.
>2014-06-19 14:37:42,399 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-7) SSH execute root@10.66.8.153 'mkdir -p '/data/updates''
>2014-06-19 14:40:52,337 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Timeout during node 10.66.9.184 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.9.184'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:40:52,338 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Installation 10.66.9.184: Processing stopped due to timeout
>2014-06-19 14:40:52,359 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Correlation ID: 27e91e66, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host dhcp-9-184.nay.redhat.com. Processing stopped due to timeout.
>2014-06-19 14:40:52,359 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Host installation failed for host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.9.184'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:40:52,363 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 40b87f88
>2014-06-19 14:40:52,417 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] FINISH, SetVdsStatusVDSCommand, log id: 40b87f88
>2014-06-19 14:40:52,434 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Correlation ID: 27e91e66, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com installation failed. SSH session timeout host 'root@10.66.9.184'.
>2014-06-19 14:40:52,434 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-29) [27e91e66] Lock freed to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:42:42,550 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Timeout during node 10.66.8.153 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.8.153'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:42:42,551 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Installation 10.66.8.153: Processing stopped due to timeout
>2014-06-19 14:42:42,640 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Correlation ID: 61f2d546, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host dhcp-8-153.nay.redhat.com. Processing stopped due to timeout.
>2014-06-19 14:42:42,640 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Host installation failed for host be0af7ef-2efb-492d-bcd8-e6dff09a5805, dhcp-8-153.nay.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.8.153'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:42:42,644 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 642a0400
>2014-06-19 14:42:42,693 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] FINISH, SetVdsStatusVDSCommand, log id: 642a0400
>2014-06-19 14:42:42,714 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Correlation ID: 61f2d546, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-8-153.nay.redhat.com installation failed. SSH session timeout host 'root@10.66.8.153'.
>2014-06-19 14:42:42,714 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [61f2d546] Lock freed to object EngineLock [exclusiveLocks= key: be0af7ef-2efb-492d-bcd8-e6dff09a5805 value: VDS
>, sharedLocks= ]
>2014-06-19 14:49:15,619 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-6) [28c877e2] Lock Acquired to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:49:15,727 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Running command: ActivateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:49:15,727 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Before acquiring lock in order to prevent monitoring for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:49:15,727 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Lock acquired, from now a monitoring of host will be skipped for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:49:15,756 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3af79298
>2014-06-19 14:49:15,777 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] FINISH, SetVdsStatusVDSCommand, log id: 3af79298
>2014-06-19 14:49:15,794 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Activate finished. Lock released. Monitoring can run now for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:49:15,843 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Correlation ID: 28c877e2, Job ID: 47227844-6c75-4a77-a312-a2d575f0a094, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was activated by admin.
>2014-06-19 14:49:15,860 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-36) [28c877e2] Lock freed to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:49:16,717 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-69) [2ea2bc57] START, GetHardwareInfoVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, vds=Host[dhcp-9-184.nay.redhat.com,f4cd046f-4623-40d7-8cdc-1a4188cd5a9a]), log id: 171440cb
>2014-06-19 14:49:16,768 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-69) [2ea2bc57] FINISH, GetHardwareInfoVDSCommand, log id: 171440cb
>2014-06-19 14:49:16,840 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-69) [32eeae5e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:49:16,877 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) [32eeae5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:49:16,934 INFO  [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-69) [134dfa81] Running command: InitVdsOnUpCommand internal: true. Entities affected :  ID: 21be17d7-5769-4c9e-8071-ef9f25a99439 Type: StoragePool
>2014-06-19 14:49:16,962 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-69) [134dfa81] START, SetMOMPolicyParametersVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: 1f8f520
>2014-06-19 14:49:17,105 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-69) [134dfa81] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1f8f520
>2014-06-19 14:49:17,120 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) [134dfa81] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:49:17,152 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-69) [48620498] Running command: HandleVdsVersionCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:49:41,588 INFO  [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-9) Registration request: source='10.66.9.184', secured='true', address='10.66.9.184', vdsPort=54321, name='dhcp-9-184.nay.redhat.com', uniqueId='4C4C4544-0054-4D10-8038-C6C04F353358'
>2014-06-19 14:49:41,593 ERROR [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-9) Query execution failed due to invalid inputs. VDS_STATUS_NOT_VALID_FOR_UPDATE
>2014-06-19 14:49:50,702 INFO  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-8) [1ca309aa] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:49:50,705 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1ca309aa] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 1e651394
>2014-06-19 14:49:50,755 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [1ca309aa] FINISH, SetVdsStatusVDSCommand, log id: 1e651394
>2014-06-19 14:49:50,839 INFO  [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-8) [1ca309aa] Running command: MaintenanceVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:49:50,856 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [1ca309aa] Correlation ID: 1ca309aa, Job ID: 834b6849-cf60-4bbb-88d4-01f735f1307c, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was switched to Maintenance mode by admin.
>2014-06-19 14:49:51,179 INFO  [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) [57b12f6f] Updated vds status from Preparing for Maintenance to Maintenance in database,  vds = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a : dhcp-9-184.nay.redhat.com
>2014-06-19 14:50:13,900 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:50:13,900 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:50:13,900 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-8) [6a8f7654] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:50:13,987 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:50:13,987 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:50:13,987 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-8) [6a8f7654] Lock Acquired to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:50:13,994 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Running command: InstallVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:50:13,994 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Execute upgrade host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com
>2014-06-19 14:50:13,997 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 33e8afb2
>2014-06-19 14:50:14,029 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [6a8f7654] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:50:14,037 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] FINISH, SetVdsStatusVDSCommand, log id: 33e8afb2
>2014-06-19 14:50:14,062 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [6a8f7654] Correlation ID: 6a8f7654, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:50:14,229 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Installation 10.66.9.184: Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13
>2014-06-19 14:50:14,245 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Correlation ID: 6a8f7654, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13.
>2014-06-19 14:50:14,597 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Installation 10.66.9.184: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso
>2014-06-19 14:50:14,612 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Correlation ID: 6a8f7654, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso.
>2014-06-19 14:50:14,612 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-15) SSH execute root@10.66.9.184 'mkdir -p '/data/updates''
>2014-06-19 14:55:14,706 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Timeout during node 10.66.9.184 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.9.184'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:55:14,707 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Installation 10.66.9.184: Processing stopped due to timeout
>2014-06-19 14:55:14,759 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Correlation ID: 6a8f7654, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host dhcp-9-184.nay.redhat.com. Processing stopped due to timeout.
>2014-06-19 14:55:14,760 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Host installation failed for host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.66.9.184'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:]
>	at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 14:55:14,764 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 13e94952
>2014-06-19 14:55:14,790 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] FINISH, SetVdsStatusVDSCommand, log id: 13e94952
>2014-06-19 14:55:14,809 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Correlation ID: 6a8f7654, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com installation failed. SSH session timeout host 'root@10.66.9.184'.
>2014-06-19 14:55:14,809 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6a8f7654] Lock freed to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:56:25,930 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-10) [522c863a] Lock Acquired to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:56:26,031 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] Running command: ActivateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:56:26,031 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] Before acquiring lock in order to prevent monitoring for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:56:26,031 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] Lock acquired, from now a monitoring of host will be skipped for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:56:26,061 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2fed6c7c
>2014-06-19 14:56:26,081 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] FINISH, SetVdsStatusVDSCommand, log id: 2fed6c7c
>2014-06-19 14:56:26,101 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] Activate finished. Lock released. Monitoring can run now for host dhcp-9-184.nay.redhat.com from data-center hadongupgrade1
>2014-06-19 14:56:26,123 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [522c863a] Correlation ID: 522c863a, Job ID: 8afecfb8-4941-4252-9b56-7004452cbf73, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was activated by admin.
>2014-06-19 14:56:26,139 INFO  [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-6) [522c863a] Lock freed to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:56:28,107 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GetHardwareInfoVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, vds=Host[dhcp-9-184.nay.redhat.com,f4cd046f-4623-40d7-8cdc-1a4188cd5a9a]), log id: 37ccce78
>2014-06-19 14:56:28,239 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GetHardwareInfoVDSCommand, log id: 37ccce78
>2014-06-19 14:56:28,309 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-80) [68a97b4d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:56:28,340 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-80) [68a97b4d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:56:28,386 INFO  [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-80) [1ba02752] Running command: InitVdsOnUpCommand internal: true. Entities affected :  ID: 21be17d7-5769-4c9e-8071-ef9f25a99439 Type: StoragePool
>2014-06-19 14:56:28,413 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-80) [1ba02752] START, SetMOMPolicyParametersVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a), log id: 1329a4c0
>2014-06-19 14:56:28,542 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-80) [1ba02752] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1329a4c0
>2014-06-19 14:56:28,558 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-80) [1ba02752] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:56:28,599 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-80) [7efc1e0] Running command: HandleVdsVersionCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:56:37,515 INFO  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-27) [5ae23196] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:56:37,518 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5ae23196] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 633109c
>2014-06-19 14:56:37,559 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [5ae23196] FINISH, SetVdsStatusVDSCommand, log id: 633109c
>2014-06-19 14:56:37,658 INFO  [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-27) [5ae23196] Running command: MaintenanceVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:56:37,697 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [5ae23196] Correlation ID: 5ae23196, Job ID: b861adc1-2f21-4bcd-a7fe-d0db64a8fda4, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com was switched to Maintenance mode by admin.
>2014-06-19 14:56:38,024 INFO  [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-16) Updated vds status from Preparing for Maintenance to Maintenance in database,  vds = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a : dhcp-9-184.nay.redhat.com
>2014-06-19 14:57:10,424 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-1) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:57:10,424 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-1) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:57:10,425 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-1) [2424ea6b] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:57:10,499 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-1) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:57:10,499 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-1) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:57:10,500 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-1) [2424ea6b] Lock Acquired to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:57:10,507 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Running command: InstallVdsCommand internal: true. Entities affected :  ID: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a Type: VDS
>2014-06-19 14:57:10,507 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Execute upgrade host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com
>2014-06-19 14:57:10,511 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 69b5bfa
>2014-06-19 14:57:10,539 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [2424ea6b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-9-184.nay.redhat.com.
>2014-06-19 14:57:10,549 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] FINISH, SetVdsStatusVDSCommand, log id: 69b5bfa
>2014-06-19 14:57:10,583 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [2424ea6b] Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:57:10,769 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Installation 10.66.9.184: Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13
>2014-06-19 14:57:10,808 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Connected to host 10.66.9.184 with SSH key fingerprint: 75:84:60:87:54:82:8c:38:b1:b9:40:d0:38:13:22:13.
>2014-06-19 14:57:10,903 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Installation 10.66.9.184: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso
>2014-06-19 14:57:10,932 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso.
>2014-06-19 14:57:10,936 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-28) SSH execute root@10.66.9.184 'mkdir -p '/data/updates''
>2014-06-19 14:57:37,413 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Installation 10.66.9.184: Executing /usr/share/vdsm-reg/vdsm-upgrade
>2014-06-19 14:57:37,446 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Executing /usr/share/vdsm-reg/vdsm-upgrade.
>2014-06-19 14:57:37,446 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-28) SSH execute root@10.66.9.184 '/usr/share/vdsm-reg/vdsm-upgrade'
>2014-06-19 14:57:53,372 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.9.184: <BSTRAP component='RHEL_INSTALL' status='OK' message='vdsm daemon stopped for upgrade process!'/>
>2014-06-19 14:57:53,378 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.9.184: Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! 
>2014-06-19 14:57:53,428 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! .
>2014-06-19 14:57:53,428 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.9.184: <BSTRAP component='setMountPoint' status='OK' message='Mount succeeded.'/>
>2014-06-19 14:57:53,429 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.9.184: Step: setMountPoint; Details: Mount succeeded. 
>2014-06-19 14:57:53,445 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Step: setMountPoint; Details: Mount succeeded. .
>2014-06-19 14:57:53,445 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.9.184: <BSTRAP component='doUpgrade' status='OK' message='Upgrade Succeeded. Rebooting'/>
>2014-06-19 14:57:53,446 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.9.184: Step: doUpgrade; Details: Upgrade Succeeded. Rebooting 
>2014-06-19 14:57:53,461 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Step: doUpgrade; Details: Upgrade Succeeded. Rebooting .
>2014-06-19 14:57:53,462 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.9.184: <BSTRAP component='umount' status='OK' message='umount Succeeded'/>
>2014-06-19 14:57:53,462 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.9.184: Step: umount; Details: umount Succeeded 
>2014-06-19 14:57:53,487 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Step: umount; Details: umount Succeeded .
>2014-06-19 14:57:53,487 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.9.184: <BSTRAP component='RHEV_INSTALL' status='OK'/>
>2014-06-19 14:57:53,491 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.9.184: Step: RHEV_INSTALL
>2014-06-19 14:57:53,511 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-9-184.nay.redhat.com. Step: RHEV_INSTALL.
>2014-06-19 14:57:53,514 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Reboot, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 317a2b00
>2014-06-19 14:57:53,580 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] FINISH, SetVdsStatusVDSCommand, log id: 317a2b00
>2014-06-19 14:57:53,580 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-23) [2424ea6b] Waiting 300 seconds, for server to finish reboot process.
>2014-06-19 14:57:53,580 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] After upgrade host f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, dhcp-9-184.nay.redhat.com: success
>2014-06-19 14:57:53,604 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Correlation ID: 2424ea6b, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-9-184.nay.redhat.com installed
>2014-06-19 14:57:53,605 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2424ea6b] Lock freed to object EngineLock [exclusiveLocks= key: f4cd046f-4623-40d7-8cdc-1a4188cd5a9a value: VDS
>, sharedLocks= ]
>2014-06-19 14:58:21,124 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-2) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:58:21,124 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-2) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:58:21,125 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-2) [6d1816d0] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 14:58:21,179 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-2) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:58:21,179 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-2) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 14:58:21,181 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-2) [6d1816d0] Lock Acquired to object EngineLock [exclusiveLocks= key: be0af7ef-2efb-492d-bcd8-e6dff09a5805 value: VDS
>, sharedLocks= ]
>2014-06-19 14:58:21,184 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Running command: InstallVdsCommand internal: true. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 14:58:21,185 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Execute upgrade host be0af7ef-2efb-492d-bcd8-e6dff09a5805, dhcp-8-153.nay.redhat.com
>2014-06-19 14:58:21,188 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4d4ae08e
>2014-06-19 14:58:21,211 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6d1816d0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-8-153.nay.redhat.com.
>2014-06-19 14:58:21,227 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] FINISH, SetVdsStatusVDSCommand, log id: 4d4ae08e
>2014-06-19 14:58:21,259 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6d1816d0] Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-8-153.nay.redhat.com configuration was updated by admin.
>2014-06-19 14:58:21,428 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Installation 10.66.8.153: Connected to host 10.66.8.153 with SSH key fingerprint: d7:f9:e1:06:59:c0:04:c8:0d:8f:a8:e6:72:01:1a:e7
>2014-06-19 14:58:21,452 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Connected to host 10.66.8.153 with SSH key fingerprint: d7:f9:e1:06:59:c0:04:c8:0d:8f:a8:e6:72:01:1a:e7.
>2014-06-19 14:58:21,520 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Installation 10.66.8.153: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso
>2014-06-19 14:58:21,553 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140618.0.el6ev.iso to /data/updates/ovirt-node-image.iso.
>2014-06-19 14:58:21,553 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-19) SSH execute root@10.66.8.153 'mkdir -p '/data/updates''
>2014-06-19 14:58:47,583 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Installation 10.66.8.153: Executing /usr/share/vdsm-reg/vdsm-upgrade
>2014-06-19 14:58:47,632 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Executing /usr/share/vdsm-reg/vdsm-upgrade.
>2014-06-19 14:58:47,632 INFO  [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-19) SSH execute root@10.66.8.153 '/usr/share/vdsm-reg/vdsm-upgrade'
>2014-06-19 14:59:09,013 INFO  [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-9) Registration request: source='10.66.9.184', secured='true', address='10.66.9.184', vdsPort=54321, name='dhcp-9-184.nay.redhat.com', uniqueId='4C4C4544-0054-4D10-8038-C6C04F353358'
>2014-06-19 14:59:09,019 ERROR [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-9) Query execution failed due to invalid inputs. VDS_STATUS_NOT_VALID_FOR_UPDATE
>2014-06-19 14:59:22,488 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.8.153: <BSTRAP component='RHEL_INSTALL' status='OK' message='vdsm daemon stopped for upgrade process!'/>
>2014-06-19 14:59:22,490 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.8.153: Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! 
>2014-06-19 14:59:22,511 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! .
>2014-06-19 14:59:22,511 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.8.153: <BSTRAP component='setMountPoint' status='OK' message='Mount succeeded.'/>
>2014-06-19 14:59:22,512 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.8.153: Step: setMountPoint; Details: Mount succeeded. 
>2014-06-19 14:59:22,536 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Step: setMountPoint; Details: Mount succeeded. .
>2014-06-19 14:59:22,536 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.8.153: <BSTRAP component='doUpgrade' status='OK' message='Upgrade Succeeded. Rebooting'/>
>2014-06-19 14:59:22,541 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.8.153: Step: doUpgrade; Details: Upgrade Succeeded. Rebooting 
>2014-06-19 14:59:22,561 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Step: doUpgrade; Details: Upgrade Succeeded. Rebooting .
>2014-06-19 14:59:22,561 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.8.153: <BSTRAP component='umount' status='OK' message='umount Succeeded'/>
>2014-06-19 14:59:22,561 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.8.153: Step: umount; Details: umount Succeeded 
>2014-06-19 14:59:22,577 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Step: umount; Details: umount Succeeded .
>2014-06-19 14:59:22,577 INFO  [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.66.8.153: <BSTRAP component='RHEV_INSTALL' status='OK'/>
>2014-06-19 14:59:22,578 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.66.8.153: Step: RHEV_INSTALL
>2014-06-19 14:59:22,594 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host dhcp-8-153.nay.redhat.com. Step: RHEV_INSTALL.
>2014-06-19 14:59:22,597 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=Reboot, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2efa5ee7
>2014-06-19 14:59:22,619 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] FINISH, SetVdsStatusVDSCommand, log id: 2efa5ee7
>2014-06-19 14:59:22,619 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-37) [6d1816d0] Waiting 300 seconds, for server to finish reboot process.
>2014-06-19 14:59:22,620 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] After upgrade host be0af7ef-2efb-492d-bcd8-e6dff09a5805, dhcp-8-153.nay.redhat.com: success
>2014-06-19 14:59:22,685 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Correlation ID: 6d1816d0, Call Stack: null, Custom Event ID: -1, Message: Host dhcp-8-153.nay.redhat.com installed
>2014-06-19 14:59:22,685 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-19) [6d1816d0] Lock freed to object EngineLock [exclusiveLocks= key: be0af7ef-2efb-492d-bcd8-e6dff09a5805 value: VDS
>, sharedLocks= ]
>2014-06-19 15:01:43,130 INFO  [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginAdminUserCommand internal: false.
>2014-06-19 15:01:43,152 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in.
>2014-06-19 15:01:43,325 ERROR [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp-/127.0.0.1:8702-4) Retrieving non string value from session
>2014-06-19 15:01:43,496 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-2) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response.
>2014-06-19 15:02:53,583 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [2424ea6b] START, SetVdsStatusVDSCommand(HostName = dhcp-9-184.nay.redhat.com, HostId = f4cd046f-4623-40d7-8cdc-1a4188cd5a9a, status=Maintenance, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 42c2ddd8
>2014-06-19 15:02:53,634 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [2424ea6b] FINISH, SetVdsStatusVDSCommand, log id: 42c2ddd8
>2014-06-19 15:04:22,623 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) [6d1816d0] START, SetVdsStatusVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, status=NonResponsive, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4dde3b6d
>2014-06-19 15:04:22,673 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-37) [6d1816d0] FINISH, SetVdsStatusVDSCommand, log id: 4dde3b6d
>2014-06-19 15:04:25,365 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GetHardwareInfoVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, vds=Host[dhcp-8-153.nay.redhat.com,be0af7ef-2efb-492d-bcd8-e6dff09a5805]), log id: 6b3d7ad7
>2014-06-19 15:04:25,533 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GetHardwareInfoVDSCommand, log id: 6b3d7ad7
>2014-06-19 15:04:25,593 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-97) [2f196db0] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 15:04:25,656 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) [2f196db0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host dhcp-8-153.nay.redhat.com.
>2014-06-19 15:04:25,682 INFO  [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-97) [3df58f2d] Running command: InitVdsOnUpCommand internal: true. Entities affected :  ID: 4bacc556-6726-4686-a3b8-4466ff48e6c7 Type: StoragePool
>2014-06-19 15:04:25,704 INFO  [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected :  ID: 4bacc556-6726-4686-a3b8-4466ff48e6c7 Type: StoragePool
>2014-06-19 15:04:25,717 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] START, ConnectStorageServerVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, storageType = NFS, connectionList = [{ id: 606ae5f7-a7a3-4fd7-92c2-63ae8090bff5, connection: 10.66.8.184:/home/vol/cshao/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b809f6e
>2014-06-19 15:04:26,309 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] FINISH, ConnectStorageServerVDSCommand, return: {606ae5f7-a7a3-4fd7-92c2-63ae8090bff5=0}, log id: 3b809f6e
>2014-06-19 15:04:26,309 INFO  [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] Host dhcp-8-153.nay.redhat.com storage connection was succeeded 
>2014-06-19 15:04:26,321 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-29) START, ConnectStoragePoolVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, vds_spm_id = 1, masterDomainId = 92cacd80-0e07-4b9b-b67f-2a9383854807, masterVersion = 1), log id: cc2c7c7
>2014-06-19 15:04:27,663 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-29) FINISH, ConnectStoragePoolVDSCommand, log id: cc2c7c7
>2014-06-19 15:04:27,769 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] START, SetMOMPolicyParametersVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805), log id: 1d56144d
>2014-06-19 15:04:27,948 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-97) [451c39b0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1d56144d
>2014-06-19 15:04:27,960 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) [451c39b0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dhcp-8-153.nay.redhat.com.
>2014-06-19 15:04:27,988 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-97) [45645b07] Running command: HandleVdsVersionCommand internal: true. Entities affected :  ID: be0af7ef-2efb-492d-bcd8-e6dff09a5805 Type: VDS
>2014-06-19 15:04:37,876 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-41) hostFromVds::selectedVds - dhcp-8-153.nay.redhat.com, spmStatus Free, storage pool add
>2014-06-19 15:04:37,896 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-41) starting spm on vds dhcp-8-153.nay.redhat.com, storage pool add, prevId -1, LVER 0
>2014-06-19 15:04:37,899 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) START, SpmStartVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, prevId=-1, prevLVER=0, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3d229a13
>2014-06-19 15:04:37,961 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling started: taskId = 9c60dafe-64eb-4577-84ce-40d760e2f8ce
>2014-06-19 15:04:49,355 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling ended: taskId = 9c60dafe-64eb-4577-84ce-40d760e2f8ce task status = finished
>2014-06-19 15:04:49,425 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling ended, spm status: SPM
>2014-06-19 15:04:49,428 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-41) START, HSMClearTaskVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805, taskId=9c60dafe-64eb-4577-84ce-40d760e2f8ce), log id: 52db8979
>2014-06-19 15:04:49,504 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, HSMClearTaskVDSCommand, log id: 52db8979
>2014-06-19 15:04:49,504 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5a5333af, log id: 3d229a13
>2014-06-19 15:04:49,520 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-41) Initialize Irs proxy from vds: 10.66.8.153
>2014-06-19 15:04:49,553 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dhcp-8-153.nay.redhat.com (Address: 10.66.8.153).
>2014-06-19 15:04:49,612 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, ignoreFailoverLimit = false), log id: 31207e4d
>2014-06-19 15:04:49,736 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-21) -- executeIrsBrokerCommand: Attempting on storage pool 4bacc556-6726-4686-a3b8-4466ff48e6c7
>2014-06-19 15:04:49,740 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, HSMGetAllTasksInfoVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId = be0af7ef-2efb-492d-bcd8-e6dff09a5805), log id: 18bde589
>2014-06-19 15:04:49,766 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 18bde589
>2014-06-19 15:04:49,766 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 31207e4d
>2014-06-19 15:04:49,766 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-21) Discovered no tasks on Storage Pool add
>2014-06-19 15:05:21,215 INFO  [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-10) Registration request: source='10.66.9.184', secured='true', address='10.66.9.184', vdsPort=54321, name='dhcp-9-184.nay.redhat.com', uniqueId='4C4C4544-0054-4D10-8038-C6C04F353358'
>2014-06-19 15:05:21,222 ERROR [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-10) Query execution failed due to invalid inputs. VDS_STATUS_NOT_VALID_FOR_UPDATE
>2014-06-19 15:07:55,788 INFO  [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-6) Registration request: source='10.66.72.105', secured='true', address='10.66.72.105', vdsPort=54321, name='localhost.localdomain', uniqueId='44454C4C-4A00-1047-804A-C4C04F4D3258'
>2014-06-19 15:07:55,833 INFO  [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-6) Running Command: RegisterVds
>2014-06-19 15:07:55,979 INFO  [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-6) [d454a47] Running command: AddVdsCommand internal: true. Entities affected :  ID: 00000001-0001-0001-0001-000000000111 Type: VdsGroups
>2014-06-19 15:07:56,077 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [109a2037] Running command: AddVdsSpmIdCommand internal: true. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:07:56,154 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [109a2037] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000035f value: REGISTER_VDS
>, sharedLocks= ]
>2014-06-19 15:07:56,157 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] START, RemoveVdsVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd), log id: 72aed286
>2014-06-19 15:07:56,158 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] FINISH, RemoveVdsVDSCommand, log id: 72aed286
>2014-06-19 15:07:56,160 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] START, AddVdsVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd), log id: 6be43f7c
>2014-06-19 15:07:56,160 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] AddVds - entered , starting logic to add VDS f4dc5721-dc7d-4210-a401-848a939c22bd
>2014-06-19 15:07:56,162 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] AddVds - VDS f4dc5721-dc7d-4210-a401-848a939c22bd was added, will try to add it to the resource manager
>2014-06-19 15:07:56,162 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [109a2037] Entered VdsManager constructor
>2014-06-19 15:07:56,181 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [109a2037] Initialize vdsBroker (10.66.72.105,54,321)
>2014-06-19 15:07:56,182 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [109a2037] VDS f4dc5721-dc7d-4210-a401-848a939c22bd was added to the Resource Manager
>2014-06-19 15:07:56,183 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [109a2037] FINISH, AddVdsVDSCommand, log id: 6be43f7c
>2014-06-19 15:07:56,196 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [109a2037] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host localhost.localdomain.
>2014-06-19 15:07:56,239 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [109a2037] Correlation ID: d454a47, Call Stack: null, Custom Event ID: -1, Message: Host localhost.localdomain was added by Non interactive user.
>2014-06-19 15:07:56,239 INFO  [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-6) [109a2037] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: localhost.localdomain, Hostname: 10.66.72.105, UniqueID: 44454C4C-4A00-1047-804A-C4C04F4D3258
>2014-06-19 15:07:56,275 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [109a2037] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host localhost.localdomain registered.
>2014-06-19 15:08:08,234 INFO  [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] Running command: ChangeVDSClusterCommand internal: false. Entities affected :  ID: 42571b2b-473a-421b-9fa4-cf5ab3b43180 Type: VdsGroups
>2014-06-19 15:08:08,252 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] START, RemoveVdsVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd), log id: 2aa9c811
>2014-06-19 15:08:08,252 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [7816d51d] vdsManager::disposing
>2014-06-19 15:08:08,253 INFO  [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] FINISH, RemoveVdsVDSCommand, log id: 2aa9c811
>2014-06-19 15:08:08,255 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] START, AddVdsVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd), log id: 56d1e594
>2014-06-19 15:08:08,255 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] AddVds - entered , starting logic to add VDS f4dc5721-dc7d-4210-a401-848a939c22bd
>2014-06-19 15:08:08,257 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] AddVds - VDS f4dc5721-dc7d-4210-a401-848a939c22bd was added, will try to add it to the resource manager
>2014-06-19 15:08:08,257 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [7816d51d] Entered VdsManager constructor
>2014-06-19 15:08:08,283 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [7816d51d] Initialize vdsBroker (10.66.72.105,54,321)
>2014-06-19 15:08:08,284 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-8) [7816d51d] VDS f4dc5721-dc7d-4210-a401-848a939c22bd was added to the Resource Manager
>2014-06-19 15:08:08,284 INFO  [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [7816d51d] FINISH, AddVdsVDSCommand, log id: 56d1e594
>2014-06-19 15:08:08,326 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [e4868c7] Running command: AddVdsSpmIdCommand internal: true. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:08,348 INFO  [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [e4868c7] Lock freed to object EngineLock [exclusiveLocks= key: 5d63f8cb-f705-4766-86b4-544e6d693277 value: REGISTER_VDS
>, sharedLocks= ]
>2014-06-19 15:08:08,376 INFO  [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-12) [7a97dc59] Running command: PersistentSetupNetworksCommand internal: true. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:08,387 WARN  [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-12) [7a97dc59] CanDoAction of action SetupNetworks failed. Reasons:VAR__ACTION__SETUP,VAR__TYPE__NETWORKS,VAR__HOST_STATUS__UP_MAINTENANCE_OR_NON_OPERATIONAL,ACTION_TYPE_FAILED_VDS_STATUS_ILLEGAL
>2014-06-19 15:08:08,406 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [e4868c7] Correlation ID: 7816d51d, Call Stack: null, Custom Event ID: -1, Message: Host localhost.localdomain configuration was updated by admin.
>2014-06-19 15:08:08,479 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 15:08:08,479 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 15:08:08,479 INFO  [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-4) [20f9bad2] Running command: UpdateVdsCommand internal: false. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:08,514 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 15:08:08,514 WARN  [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic
>2014-06-19 15:08:08,553 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [20f9bad2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host localhost.localdomain.
>2014-06-19 15:08:08,587 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [20f9bad2] Correlation ID: 20f9bad2, Call Stack: null, Custom Event ID: -1, Message: Host localhost.localdomain configuration was updated by admin.
>2014-06-19 15:08:09,158 INFO  [org.ovirt.engine.core.bll.ApproveVdsCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] Running command: ApproveVdsCommand internal: false. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:09,158 INFO  [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] Before Installation host f4dc5721-dc7d-4210-a401-848a939c22bd, localhost.localdomain
>2014-06-19 15:08:09,219 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] START, SetVdsStatusVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 15c1232f
>2014-06-19 15:08:09,258 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] FINISH, SetVdsStatusVDSCommand, log id: 15c1232f
>2014-06-19 15:08:09,429 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-15) [378e52ae] Error during host 10.66.72.105 install: java.io.IOException: SSH session closed during connection 'root@10.66.72.105'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:309) [utils.jar:]
>	at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.connect(SSHDialog.java:249) [utils.jar:]
>	at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1019) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:241) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.ApproveVdsCommand.executeCommand(ApproveVdsCommand.java:45) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 15:08:09,430 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] Host installation failed for host f4dc5721-dc7d-4210-a401-848a939c22bd, localhost.localdomain.: java.io.IOException: SSH session closed during connection 'root@10.66.72.105'
>	at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:309) [utils.jar:]
>	at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:]
>	at org.ovirt.engine.core.utils.ssh.SSHDialog.connect(SSHDialog.java:249) [utils.jar:]
>	at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1019) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:241) [bll.jar:]
>	at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.ApproveVdsCommand.executeCommand(ApproveVdsCommand.java:45) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
>	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:]
>	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:]
>	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:]
>	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:]
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51]
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51]
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51]
>	at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]
>
>2014-06-19 15:08:09,434 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] START, SetVdsStatusVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1457406c
>2014-06-19 15:08:09,474 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-15) [378e52ae] FINISH, SetVdsStatusVDSCommand, log id: 1457406c
>2014-06-19 15:08:09,495 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [378e52ae] Correlation ID: 378e52ae, Job ID: b4be59e1-e025-4c32-a809-288a5a459f0d, Call Stack: null, Custom Event ID: -1, Message: Host localhost.localdomain installation failed. SSH session closed during connection 'root@10.66.72.105'.
>2014-06-19 15:08:11,288 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: localhost.localdomain
>2014-06-19 15:08:50,483 WARN  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-5) [785e80cc] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL
>2014-06-19 15:08:58,284 INFO  [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (ajp-/127.0.0.1:8702-3) [3d094737] Lock Acquired to object EngineLock [exclusiveLocks= key: f4dc5721-dc7d-4210-a401-848a939c22bd value: VDS_FENCE
>, sharedLocks= ]
>2014-06-19 15:08:58,291 INFO  [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (org.ovirt.thread.pool-4-thread-3) [3d094737] Running command: FenceVdsManualyCommand internal: false. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:58,317 INFO  [org.ovirt.engine.core.bll.ClearNonResponsiveVdsVmsCommand] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] Running command: ClearNonResponsiveVdsVmsCommand internal: true. Entities affected :  ID: f4dc5721-dc7d-4210-a401-848a939c22bd Type: VDS
>2014-06-19 15:08:58,331 INFO  [org.ovirt.engine.core.vdsbroker.UpdateVdsVMsClearedVDSCommand] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] START, UpdateVdsVMsClearedVDSCommand(HostName = localhost.localdomain, HostId = f4dc5721-dc7d-4210-a401-848a939c22bd), log id: 172bf595
>2014-06-19 15:08:58,364 INFO  [org.ovirt.engine.core.vdsbroker.UpdateVdsVMsClearedVDSCommand] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] FINISH, UpdateVdsVMsClearedVDSCommand, log id: 172bf595
>2014-06-19 15:08:58,410 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] Correlation ID: 5b4aa553, Call Stack: null, Custom Event ID: -1, Message: All VMs' status on Non Responsive Host localhost.localdomain were changed to 'Down' by admin
>2014-06-19 15:08:58,452 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] Correlation ID: 3d094737, Call Stack: null, Custom Event ID: -1, Message: Manual fence for host localhost.localdomain was started.
>2014-06-19 15:08:58,452 INFO  [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (org.ovirt.thread.pool-4-thread-3) [5b4aa553] Lock freed to object EngineLock [exclusiveLocks= key: f4dc5721-dc7d-4210-a401-848a939c22bd value: VDS_FENCE
>, sharedLocks= ]
>2014-06-19 15:09:02,498 WARN  [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-9) [41687587] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL
>2014-06-19 15:10:14,607 INFO  [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-10) [6fd9430a] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs-vm1 value: VM_NAME
>, sharedLocks= ]
>2014-06-19 15:10:14,803 INFO  [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-10) [6fd9430a] Running command: AddVmFromScratchCommand internal: false. Entities affected :  ID: 96a5da1b-c489-4412-acfc-da0ee145beb6 Type: VdsGroups
>2014-06-19 15:10:15,328 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [6fd9430a] Correlation ID: 6fd9430a, Job ID: e9134380-6402-41e6-b86a-21a54d5ad3ca, Call Stack: null, Custom Event ID: -1, Message: VM nfs-vm1 was created by admin.
>2014-06-19 15:10:15,368 INFO  [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-10) [6fd9430a] Lock freed to object EngineLock [exclusiveLocks= key: nfs-vm1 value: VM_NAME
>, sharedLocks= ]
>2014-06-19 15:10:17,042 INFO  [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-5) [15ebc100] Running command: ReorderVmNicsCommand internal: false. Entities affected :  ID: 21531493-d281-4199-ad80-abc6178f8fd3 Type: VM
>2014-06-19 15:10:43,237 INFO  [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [1b15c569] Lock Acquired to object EngineLock [exclusiveLocks= key: 21531493-d281-4199-ad80-abc6178f8fd3 value: VM_DISK_BOOT
>, sharedLocks= key: 21531493-d281-4199-ad80-abc6178f8fd3 value: VM
>]
>2014-06-19 15:10:43,290 INFO  [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [1b15c569] Running command: AddDiskCommand internal: false. Entities affected :  ID: 21531493-d281-4199-ad80-abc6178f8fd3 Type: VM,  ID: 92cacd80-0e07-4b9b-b67f-2a9383854807 Type: Storage
>2014-06-19 15:10:43,525 INFO  [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [442b7307] Running command: AddImageFromScratchCommand internal: true. Entities affected :  ID: 92cacd80-0e07-4b9b-b67f-2a9383854807 Type: Storage
>2014-06-19 15:10:43,576 INFO  [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [442b7307] Lock freed to object EngineLock [exclusiveLocks= key: 21531493-d281-4199-ad80-abc6178f8fd3 value: VM_DISK_BOOT
>, sharedLocks= key: 21531493-d281-4199-ad80-abc6178f8fd3 value: VM
>]
>2014-06-19 15:10:43,576 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [442b7307] START, CreateImageVDSCommand( storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, ignoreFailoverLimit = false, storageDomainId = 92cacd80-0e07-4b9b-b67f-2a9383854807, imageGroupId = 941b88f5-61f1-43d8-a57e-a9273625ec82, imageSizeInBytes = 8589934592, volumeFormat = RAW, newImageId = 420333df-6198-4f2e-ac33-706f57d837cc, newImageDescription = ), log id: 5e348e6b
>2014-06-19 15:10:43,576 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [442b7307] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID
>2014-06-19 15:10:43,948 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [442b7307] FINISH, CreateImageVDSCommand, return: 420333df-6198-4f2e-ac33-706f57d837cc, log id: 5e348e6b
>2014-06-19 15:10:43,986 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-8) [442b7307] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 84f02b15-1d6f-4a4d-8cbd-c5c98bee09fa
>2014-06-19 15:10:43,986 INFO  [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-8) [442b7307] CommandMultiAsyncTasks::AttachTask: Attaching task e1865ce5-c4e2-4b28-9acf-738aa36d18a7 to command 84f02b15-1d6f-4a4d-8cbd-c5c98bee09fa.
>2014-06-19 15:10:44,025 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-8) [442b7307] Adding task e1865ce5-c4e2-4b28-9acf-738aa36d18a7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet..
>2014-06-19 15:10:44,142 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [442b7307] Correlation ID: 1b15c569, Job ID: d540a6c2-be6f-42df-b9bc-998e97c2937b, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of nfs-vm1_Disk1 was initiated on VM nfs-vm1 by admin.
>2014-06-19 15:10:44,142 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-8) [442b7307] BaseAsyncTask::startPollingTask: Starting to poll task e1865ce5-c4e2-4b28-9acf-738aa36d18a7.
>2014-06-19 15:10:48,911 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) [21b2248b] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now
>2014-06-19 15:10:48,964 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [21b2248b] SPMAsyncTask::PollTask: Polling task e1865ce5-c4e2-4b28-9acf-738aa36d18a7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'.
>2014-06-19 15:10:49,016 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [21b2248b] BaseAsyncTask::OnTaskEndSuccess: Task e1865ce5-c4e2-4b28-9acf-738aa36d18a7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully.
>2014-06-19 15:10:49,016 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-38) [21b2248b] CommandAsyncTask::EndActionIfNecessary: All tasks of command 84f02b15-1d6f-4a4d-8cbd-c5c98bee09fa has ended -> executing endAction
>2014-06-19 15:10:49,017 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-38) [21b2248b] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 84f02b15-1d6f-4a4d-8cbd-c5c98bee09fa): calling endAction .
>2014-06-19 15:10:49,017 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-25) [21b2248b] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0
>2014-06-19 15:10:49,058 INFO  [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-25) [1b15c569] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand
>2014-06-19 15:10:49,067 INFO  [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-25) [442b7307] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand
>2014-06-19 15:10:49,082 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [442b7307] START, GetImageInfoVDSCommand( storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, ignoreFailoverLimit = false, storageDomainId = 92cacd80-0e07-4b9b-b67f-2a9383854807, imageGroupId = 941b88f5-61f1-43d8-a57e-a9273625ec82, imageId = 420333df-6198-4f2e-ac33-706f57d837cc), log id: 7871f249
>2014-06-19 15:10:49,161 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-25) [442b7307] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@6b7c0e46, log id: 7871f249
>2014-06-19 15:10:49,225 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) Correlation ID: 1b15c569, Job ID: d540a6c2-be6f-42df-b9bc-998e97c2937b, Call Stack: null, Custom Event ID: -1, Message: The disk nfs-vm1_Disk1 was successfully added to VM nfs-vm1.
>2014-06-19 15:10:49,225 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-25) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result.
>2014-06-19 15:10:49,225 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-25) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks.
>2014-06-19 15:10:49,241 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-25) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e1865ce5-c4e2-4b28-9acf-738aa36d18a7
>2014-06-19 15:10:49,242 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-25) START, SPMClearTaskVDSCommand( storagePoolId = 4bacc556-6726-4686-a3b8-4466ff48e6c7, ignoreFailoverLimit = false, taskId = e1865ce5-c4e2-4b28-9acf-738aa36d18a7), log id: 6d647a35
>2014-06-19 15:10:49,244 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-25) START, HSMClearTaskVDSCommand(HostName = dhcp-8-153.nay.redhat.com, HostId =

Actions: View

Attachments on bug 1111086: 910299 | 911345