746033 – Simultaneous builds for vsphere and rhev hang in OZ

Bug 746033 - Simultaneous builds for vsphere and rhev hang in OZ

Summary: Simultaneous builds for vsphere and rhev hang in OZ

Keywords:
Status:	CLOSED CURRENTRELEASE
Alias:	None
Product:	CloudForms Cloud Engine
Classification:	Retired
Component:	imagefactory
Sub Component:
Version:	0.3.1
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	rc
Assignee:	jrd
QA Contact:	wes hayutin
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2011-10-13 17:41 UTC by Steve Reichard
Modified:	2013-02-27 04:26 UTC (History)
CC List:	6 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2011-10-13 17:58:25 UTC

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

Description Steve Reichard 2011-10-13 17:41:46 UTC

Description of problem:

Attempt to build for the two stated providers, requiring factory to be restarted.


Here is the template used:

<template>
  <name>rhel6_1_x86_64-web</name>
  <os>
    <name>RHEL-6</name>
    <version>1</version>
    <arch>x86_64</arch>
    <install type='url'>
      <url>http://ra-ns1.cloud.lab.eng.bos.redhat.com/ks/dist/ks-rhel-x86_64-server-6-6.1</url>
    </install>
  </os>
  <repositories>
    <repository name="myr61">
      <url>http://ra-ns1.cloud.lab.eng.bos.redhat.com/ks/dist/ks-rhel-x86_64-server-6-6.1</url>
      <signed>False</signed>
    </repository>
  </repositories>
  <packages>
    <package name="httpd"/>
    <package name="php"/>
  </packages>
  <files>
    <file name="/var/www/html/index.html" type="raw">
spr test page
    </file>
  </files>
  <commands>
    <command name="start_web">
	/sbin/chkconfig httpd on 2>&amp;1 > /root/launch_cmd.log
    </command>
  </commands>
  <description>rhel 6.1 template</description>
</template>




There is the last part of the log of first time imagefactory wedged, it no longer updates.

+++

2011-10-12 15:37:17,307 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Generating ICICLE
2011-10-12 15:37:17,681 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Generating ICICLE
2011-10-12 15:37:17,880 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Waiting for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d to shutdown, 60/60
2011-10-12 15:37:18,200 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Waiting for rhel6_1_x86_64-web-3bd998be-83b1-4f24-b5a3-4c40241faf80 to shutdown, 60/60
2011-10-12 15:37:24,896 INFO oz.Guest.RHEL6Guest pid(28209) Message: Collection Teardown
2011-10-12 15:37:24,900 INFO oz.Guest.RHEL6Guest pid(28209) Message: Setting up guestfs handle for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d
2011-10-12 15:37:24,900 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Adding disk image /var/lib/imagefactory/images/base-image-2c721da1-7d67-4f86-98e4-ab72e622ed9d.dsk
2011-10-12 15:37:24,900 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Launching guestfs
2011-10-12 15:37:27,191 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Inspecting guest OS
2011-10-12 15:37:28,043 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Getting mountpoints
2011-10-12 15:37:28,043 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Root device: /dev/VolGroup00/LogVol00
2011-10-12 15:37:28,320 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 1
2011-10-12 15:37:28,320 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting authorized_keys
2011-10-12 15:37:28,351 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 2
2011-10-12 15:37:28,351 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting sshd_config
2011-10-12 15:37:28,393 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting sshd service
2011-10-12 15:37:28,431 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 3
2011-10-12 15:37:28,431 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting iptables rules
2011-10-12 15:37:28,439 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 4
2011-10-12 15:37:28,439 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting announcement to host
2011-10-12 15:37:28,452 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Removing reportip
2011-10-12 15:37:28,452 INFO oz.Guest.RHEL6Guest pid(28209) Message: Collection Teardown
2011-10-12 15:37:28,452 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting crond service
2011-10-12 15:37:28,458 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 5
2011-10-12 15:37:28,458 INFO oz.Guest.RHEL6Guest pid(28209) Message: Setting up guestfs handle for rhel6_1_x86_64-web-3bd998be-83b1-4f24-b5a3-4c40241faf80
2011-10-12 15:37:28,471 INFO oz.Guest.RHEL6Guest pid(28209) Message: Cleaning up guestfs handle for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d
2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Adding disk image /var/lib/imagefactory/images/rhevm-image-3bd998be-83b1-4f24-b5a3-4c40241faf80.dsk
2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Syncing
2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Launching guestfs
2011-10-12 15:37:28,589 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Unmounting all
2011-10-12 15:37:30,873 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Inspecting guest OS
2011-10-12 15:37:30,906 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Killing guestfs subprocess
2011-10-12 15:37:31,872 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Getting mountpoints 
----


Here is teh equivelant for the reprocuded case, which was done on separate h/w
+++
[
[root@cf-cloudforms9 oz]# tail -40  /var/log/imagefactory.log 
2011-10-13 11:30:13,516 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Syncing
2011-10-13 11:30:15,265 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Generating ICICLE
2011-10-13 11:30:15,442 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Generating ICICLE
2011-10-13 11:30:15,816 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Waiting for rhel6_1_x86_64-web-ade08758-77d4-4adf-bfde-6901260ead1d to shutdown, 60/60
2011-10-13 11:30:16,011 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Waiting for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93 to shutdown, 60/60
2011-10-13 11:30:22,025 INFO oz.Guest.RHEL6Guest pid(9011) Message: Collection Teardown
2011-10-13 11:30:22,027 INFO oz.Guest.RHEL6Guest pid(9011) Message: Setting up guestfs handle for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93
2011-10-13 11:30:22,027 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Adding disk image /var/lib/imagefactory/images/rhevm-image-dfae7bbc-25f7-4f56-95c8-c853c6137f93.dsk
2011-10-13 11:30:22,027 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Launching guestfs
2011-10-13 11:30:24,386 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Inspecting guest OS
2011-10-13 11:30:25,417 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Getting mountpoints
2011-10-13 11:30:25,417 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Root device: /dev/VolGroup00/LogVol00
2011-10-13 11:30:25,613 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 1
2011-10-13 11:30:25,613 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting authorized_keys
2011-10-13 11:30:25,640 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 2
2011-10-13 11:30:25,641 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd_config
2011-10-13 11:30:25,661 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd service
2011-10-13 11:30:25,680 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 3
2011-10-13 11:30:25,681 INFO oz.Guest.RHEL6Guest pid(9011) Message: Collection Teardown
2011-10-13 11:30:25,681 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting iptables rules
2011-10-13 11:30:25,698 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 4
2011-10-13 11:30:25,698 INFO oz.Guest.RHEL6Guest pid(9011) Message: Setting up guestfs handle for rhel6_1_x86_64-web-ade08758-77d4-4adf-bfde-6901260ead1d
2011-10-13 11:30:25,698 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting announcement to host
2011-10-13 11:30:25,699 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Adding disk image /var/lib/imagefactory/images/base-image-ade08758-77d4-4adf-bfde-6901260ead1d.dsk
2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Removing reportip
2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Launching guestfs
2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting crond service
2011-10-13 11:30:28,069 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Inspecting guest OS
2011-10-13 11:30:28,081 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 5
2011-10-13 11:30:29,081 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Getting mountpoints
2011-10-13 11:30:29,092 INFO oz.Guest.RHEL6Guest pid(9011) Message: Cleaning up guestfs handle for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93
2011-10-13 11:30:29,092 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Root device: /dev/VolGroup00/LogVol00
2011-10-13 11:30:29,092 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Syncing
2011-10-13 11:30:29,284 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 1
2011-10-13 11:30:29,374 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Unmounting all
2011-10-13 11:30:29,374 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting authorized_keys
2011-10-13 11:30:29,409 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Killing guestfs subprocess
2011-10-13 11:30:29,436 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 2
2011-10-13 11:30:29,436 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd_config
2011-10-13 11:30:29,459 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd service
[root@cf-cloudforms9 oz]# 

---



Version-Release number of selected component (if applicable):

root@cf-cloudforms9 oz]# /pub/scripts/post_install_configuration_scripts/cf-versions 
Red Hat Enterprise Linux Server release 6.1 (Santiago)
Linux cf-cloudforms9.cloud.lab.eng.bos.redhat.com 2.6.32-131.17.1.el6.x86_64 #1 SMP Thu Sep 29 10:24:25 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
postgresql-8.4.7-2.el6.x86_64
mongodb-1.8.0-6.el6.x86_64
euca2ools-1.3.1-4.el6_0.noarch
package gsoap is not installed
ruby-1.8.7.299-7.el6_1.1.x86_64
rubygems-1.8.10-1.el6.noarch
deltacloud-core-0.5.0-0.2.1317167702git.el6.noarch
rubygem-deltacloud-client-0.4.0-3.el6.noarch
package libdeltacloud is not installed
hail-0.8-0.2.gf9c5b967.el6_0.x86_64
puppet-2.6.6-1.el6_0.noarch
aeolus-configure-2.1.0-1.el6.noarch
package condor is not installed
iwhd-0.98.15.z3-2.el6.x86_64
imagefactory-0.7.0-1.el6.noarch
aeolus-conductor-daemons-0.4.0-1.el6.noarch
aeolus-conductor-0.4.0-1.el6.noarch


How reproducible:

2 for 2 on separate h/w

Steps to Reproduce:
1. create template as above
2. issue the build:
[root@cf-cloudforms9 nodes]# aeolus-image build --target vsphere,rhevm --template /pub/projects/cloudforms/files/r61-web.xml 

Target Image: ade08758-77d4-4adf-bfde-6901260ead1d
Image: ffd8c743-9870-47ae-8fd7-9cff7aa13a48
Build: fb4995e8-2de2-40e8-8323-c75cb4e636ad
Status: BUILDING
Percent Complete: 0

Target Image: dfae7bbc-25f7-4f56-95c8-c853c6137f93
Image: ffd8c743-9870-47ae-8fd7-9cff7aa13a48
Build: fb4995e8-2de2-40e8-8323-c75cb4e636ad
Status: BUILDING
Percent Complete: 0
[root@cf-cloudforms9 nodes]# 

wait for it to stop updating the log
3.
  
Actual results:


Expected results:


Additional info:

Comment 2 wes hayutin 2011-10-13 17:58:25 UTC


*** This bug has been marked as a duplicate of bug 722805 ***

Comment 3 wes hayutin 2011-12-08 14:03:11 UTC

perm close

Note You need to log in before you can comment on or make changes to this bug.