| Summary: | Simultaneous builds for vsphere and rhev hang in OZ | ||
|---|---|---|---|
| Product: | [Retired] CloudForms Cloud Engine | Reporter: | Steve Reichard <sreichar> |
| Component: | imagefactory | Assignee: | jrd <jrd> |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | wes hayutin <whayutin> |
| Severity: | unspecified | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 0.3.1 | CC: | akarol, dajohnso, deltacloud-maint, dgao, scollier, ssachdev |
| Target Milestone: | rc | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2011-10-13 17:58:25 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
*** This bug has been marked as a duplicate of bug 722805 *** perm close |
Description of problem: Attempt to build for the two stated providers, requiring factory to be restarted. Here is the template used: <template> <name>rhel6_1_x86_64-web</name> <os> <name>RHEL-6</name> <version>1</version> <arch>x86_64</arch> <install type='url'> <url>http://ra-ns1.cloud.lab.eng.bos.redhat.com/ks/dist/ks-rhel-x86_64-server-6-6.1</url> </install> </os> <repositories> <repository name="myr61"> <url>http://ra-ns1.cloud.lab.eng.bos.redhat.com/ks/dist/ks-rhel-x86_64-server-6-6.1</url> <signed>False</signed> </repository> </repositories> <packages> <package name="httpd"/> <package name="php"/> </packages> <files> <file name="/var/www/html/index.html" type="raw"> spr test page </file> </files> <commands> <command name="start_web"> /sbin/chkconfig httpd on 2>&1 > /root/launch_cmd.log </command> </commands> <description>rhel 6.1 template</description> </template> There is the last part of the log of first time imagefactory wedged, it no longer updates. +++ 2011-10-12 15:37:17,307 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Generating ICICLE 2011-10-12 15:37:17,681 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Generating ICICLE 2011-10-12 15:37:17,880 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Waiting for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d to shutdown, 60/60 2011-10-12 15:37:18,200 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Waiting for rhel6_1_x86_64-web-3bd998be-83b1-4f24-b5a3-4c40241faf80 to shutdown, 60/60 2011-10-12 15:37:24,896 INFO oz.Guest.RHEL6Guest pid(28209) Message: Collection Teardown 2011-10-12 15:37:24,900 INFO oz.Guest.RHEL6Guest pid(28209) Message: Setting up guestfs handle for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d 2011-10-12 15:37:24,900 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Adding disk image /var/lib/imagefactory/images/base-image-2c721da1-7d67-4f86-98e4-ab72e622ed9d.dsk 2011-10-12 15:37:24,900 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Launching guestfs 2011-10-12 15:37:27,191 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Inspecting guest OS 2011-10-12 15:37:28,043 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Getting mountpoints 2011-10-12 15:37:28,043 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Root device: /dev/VolGroup00/LogVol00 2011-10-12 15:37:28,320 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 1 2011-10-12 15:37:28,320 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting authorized_keys 2011-10-12 15:37:28,351 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 2 2011-10-12 15:37:28,351 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting sshd_config 2011-10-12 15:37:28,393 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting sshd service 2011-10-12 15:37:28,431 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 3 2011-10-12 15:37:28,431 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting iptables rules 2011-10-12 15:37:28,439 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 4 2011-10-12 15:37:28,439 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting announcement to host 2011-10-12 15:37:28,452 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Removing reportip 2011-10-12 15:37:28,452 INFO oz.Guest.RHEL6Guest pid(28209) Message: Collection Teardown 2011-10-12 15:37:28,452 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Resetting crond service 2011-10-12 15:37:28,458 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Teardown step 5 2011-10-12 15:37:28,458 INFO oz.Guest.RHEL6Guest pid(28209) Message: Setting up guestfs handle for rhel6_1_x86_64-web-3bd998be-83b1-4f24-b5a3-4c40241faf80 2011-10-12 15:37:28,471 INFO oz.Guest.RHEL6Guest pid(28209) Message: Cleaning up guestfs handle for rhel6_1_x86_64-web-2c721da1-7d67-4f86-98e4-ab72e622ed9d 2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Adding disk image /var/lib/imagefactory/images/rhevm-image-3bd998be-83b1-4f24-b5a3-4c40241faf80.dsk 2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Syncing 2011-10-12 15:37:28,471 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Launching guestfs 2011-10-12 15:37:28,589 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Unmounting all 2011-10-12 15:37:30,873 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Inspecting guest OS 2011-10-12 15:37:30,906 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Killing guestfs subprocess 2011-10-12 15:37:31,872 DEBUG oz.Guest.RHEL6Guest pid(28209) Message: Getting mountpoints ---- Here is teh equivelant for the reprocuded case, which was done on separate h/w +++ [ [root@cf-cloudforms9 oz]# tail -40 /var/log/imagefactory.log 2011-10-13 11:30:13,516 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Syncing 2011-10-13 11:30:15,265 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Generating ICICLE 2011-10-13 11:30:15,442 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Generating ICICLE 2011-10-13 11:30:15,816 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Waiting for rhel6_1_x86_64-web-ade08758-77d4-4adf-bfde-6901260ead1d to shutdown, 60/60 2011-10-13 11:30:16,011 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Waiting for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93 to shutdown, 60/60 2011-10-13 11:30:22,025 INFO oz.Guest.RHEL6Guest pid(9011) Message: Collection Teardown 2011-10-13 11:30:22,027 INFO oz.Guest.RHEL6Guest pid(9011) Message: Setting up guestfs handle for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93 2011-10-13 11:30:22,027 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Adding disk image /var/lib/imagefactory/images/rhevm-image-dfae7bbc-25f7-4f56-95c8-c853c6137f93.dsk 2011-10-13 11:30:22,027 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Launching guestfs 2011-10-13 11:30:24,386 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Inspecting guest OS 2011-10-13 11:30:25,417 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Getting mountpoints 2011-10-13 11:30:25,417 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Root device: /dev/VolGroup00/LogVol00 2011-10-13 11:30:25,613 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 1 2011-10-13 11:30:25,613 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting authorized_keys 2011-10-13 11:30:25,640 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 2 2011-10-13 11:30:25,641 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd_config 2011-10-13 11:30:25,661 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd service 2011-10-13 11:30:25,680 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 3 2011-10-13 11:30:25,681 INFO oz.Guest.RHEL6Guest pid(9011) Message: Collection Teardown 2011-10-13 11:30:25,681 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting iptables rules 2011-10-13 11:30:25,698 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 4 2011-10-13 11:30:25,698 INFO oz.Guest.RHEL6Guest pid(9011) Message: Setting up guestfs handle for rhel6_1_x86_64-web-ade08758-77d4-4adf-bfde-6901260ead1d 2011-10-13 11:30:25,698 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting announcement to host 2011-10-13 11:30:25,699 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Adding disk image /var/lib/imagefactory/images/base-image-ade08758-77d4-4adf-bfde-6901260ead1d.dsk 2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Removing reportip 2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Launching guestfs 2011-10-13 11:30:25,700 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting crond service 2011-10-13 11:30:28,069 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Inspecting guest OS 2011-10-13 11:30:28,081 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 5 2011-10-13 11:30:29,081 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Getting mountpoints 2011-10-13 11:30:29,092 INFO oz.Guest.RHEL6Guest pid(9011) Message: Cleaning up guestfs handle for rhel6_1_x86_64-web-dfae7bbc-25f7-4f56-95c8-c853c6137f93 2011-10-13 11:30:29,092 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Root device: /dev/VolGroup00/LogVol00 2011-10-13 11:30:29,092 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Syncing 2011-10-13 11:30:29,284 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 1 2011-10-13 11:30:29,374 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Unmounting all 2011-10-13 11:30:29,374 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting authorized_keys 2011-10-13 11:30:29,409 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Killing guestfs subprocess 2011-10-13 11:30:29,436 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Teardown step 2 2011-10-13 11:30:29,436 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd_config 2011-10-13 11:30:29,459 DEBUG oz.Guest.RHEL6Guest pid(9011) Message: Resetting sshd service [root@cf-cloudforms9 oz]# --- Version-Release number of selected component (if applicable): root@cf-cloudforms9 oz]# /pub/scripts/post_install_configuration_scripts/cf-versions Red Hat Enterprise Linux Server release 6.1 (Santiago) Linux cf-cloudforms9.cloud.lab.eng.bos.redhat.com 2.6.32-131.17.1.el6.x86_64 #1 SMP Thu Sep 29 10:24:25 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux postgresql-8.4.7-2.el6.x86_64 mongodb-1.8.0-6.el6.x86_64 euca2ools-1.3.1-4.el6_0.noarch package gsoap is not installed ruby-1.8.7.299-7.el6_1.1.x86_64 rubygems-1.8.10-1.el6.noarch deltacloud-core-0.5.0-0.2.1317167702git.el6.noarch rubygem-deltacloud-client-0.4.0-3.el6.noarch package libdeltacloud is not installed hail-0.8-0.2.gf9c5b967.el6_0.x86_64 puppet-2.6.6-1.el6_0.noarch aeolus-configure-2.1.0-1.el6.noarch package condor is not installed iwhd-0.98.15.z3-2.el6.x86_64 imagefactory-0.7.0-1.el6.noarch aeolus-conductor-daemons-0.4.0-1.el6.noarch aeolus-conductor-0.4.0-1.el6.noarch How reproducible: 2 for 2 on separate h/w Steps to Reproduce: 1. create template as above 2. issue the build: [root@cf-cloudforms9 nodes]# aeolus-image build --target vsphere,rhevm --template /pub/projects/cloudforms/files/r61-web.xml Target Image: ade08758-77d4-4adf-bfde-6901260ead1d Image: ffd8c743-9870-47ae-8fd7-9cff7aa13a48 Build: fb4995e8-2de2-40e8-8323-c75cb4e636ad Status: BUILDING Percent Complete: 0 Target Image: dfae7bbc-25f7-4f56-95c8-c853c6137f93 Image: ffd8c743-9870-47ae-8fd7-9cff7aa13a48 Build: fb4995e8-2de2-40e8-8323-c75cb4e636ad Status: BUILDING Percent Complete: 0 [root@cf-cloudforms9 nodes]# wait for it to stop updating the log 3. Actual results: Expected results: Additional info: