Bug 794671

Summary: Push fails for F16 templates
Product: [Retired] CloudForms Cloud Engine Reporter: Shveta <ssachdev>
Component: imagefactoryAssignee: Ian McLeod <imcleod>
Status: CLOSED CURRENTRELEASE QA Contact: Martin Kočí <mkoci>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 1.0.0CC: akarol, brad, dajohnso, deltacloud-maint, dgao, hbrock, ssachdev, whayutin
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-08-30 17:13:54 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Shveta 2012-02-17 09:36:21 UTC 
Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.  Built and Pushed with fedora16 tempalte
2.
3.
  
Actual results:


Expected results:


Additional info:

in imagefactory.logs
============================================================
 2) Message: Querying (http://localhost:9090/target_images/_query) with expression ($build == "82903849-6704-46ce-b764-4e0a67bc36c7" && $target == "ec2")
2012-02-17 04:27:40,692 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 2) Message: Getting metadata (['template']) from http://localhost:9090/target_images/1a1735ef-5f82-40e0-bbed-938e4241a628
2012-02-17 04:27:40,693 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 2) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-02-17 04:27:40,697 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 2) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-02-17 04:27:40,698 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(worker 2) Message: Found neither a call-time config nor a config file - doing nothing
2012-02-17 04:27:40,718 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-02-17 04:27:44,594 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: Original URL http://download.fedoraproject.org/pub/fedora/linux/releases/16/Fedora/x86_64/os/ resolved to http://download.fedora.devel.redhat.com/pub/fedora/linux/releases/16/Fedora/x86_64/os/
2012-02-17 04:27:44,594 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: Name: factory-build-dd4ab04d-68d3-4023-962c-f08e893181e4, UUID: dc176408-8ff8-48d9-a409-a41239bc480e
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: MAC: 52:54:00:37:f9:52, distro: Fedora
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: update: 16, arch: x86_64, diskimage: /var/lib/imagefactory/images/factory-build-dd4ab04d-68d3-4023-962c-f08e893181e4.dsk
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: nicmodel: virtio, clockoffset: utc
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: mousetype: ps2, disk_bus: virtio, disk_dev: vda
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: icicletmp: /var/lib/oz/icicletmp/factory-build-dd4ab04d-68d3-4023-962c-f08e893181e4, listen_port: 55948
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: Original ISO path: /var/lib/oz/isos/Fedora16x86_64-url.iso
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: Modified ISO cache: /var/lib/oz/isos/Fedora16x86_64-url-oz.iso
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: Output ISO path: /var/lib/imagefactory/images/factory-build-dd4ab04d-68d3-4023-962c-f08e893181e4-url-oz.iso
2012-02-17 04:27:44,595 DEBUG oz.Guest.FedoraRemoteGuest thread(dd4ab04d) Message: ISO content path: /var/lib/oz/isocontent/factory-build-dd4ab04d-68d3-4023-962c-f08e893181e4-url
2012-02-17 04:27:44,596 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(dd4ab04d) Message: Being asked to push for provider ec2-us-east-1
2012-02-17 04:27:44,596 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(dd4ab04d) Message: distro: Fedora - update: 16 - arch: x86_64
2012-02-17 04:27:44,596 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(dd4ab04d) Message: acting as EC2 user: 8571-4451-8821
2012-02-17 04:27:44,597 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: dd4ab04d-68d3-4023-962c-f08e893181e4 for ec2 about to enter ec2 queue...
2012-02-17 04:27:44,597 DEBUG imgfac.ReservationManager.ReservationManager thread(dd4ab04d) Message: ENTERING queue: (ec2)
2012-02-17 04:27:44,597 DEBUG imgfac.ReservationManager.ReservationManager thread(dd4ab04d) Message: SUCCESS ENTERING queue: (ec2)
2012-02-17 04:27:44,597 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: Builder (dd4ab04d-68d3-4023-962c-f08e893181e4) changed status from NEW to PUSHING
2012-02-17 04:27:44,597 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: Builder (dd4ab04d-68d3-4023-962c-f08e893181e4) changed percent complete from 0 to 0
2012-02-17 04:27:44,597 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: Builder (dd4ab04d-68d3-4023-962c-f08e893181e4) changed status from PUSHING to FAILED
2012-02-17 04:27:44,597 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: dd4ab04d-68d3-4023-962c-f08e893181e4 for ec2 about to exit ec2 queue...
2012-02-17 04:27:44,597 DEBUG imgfac.ReservationManager.ReservationManager thread(dd4ab04d) Message: EXITING queue: (ec2)
2012-02-17 04:27:44,597 DEBUG imgfac.ReservationManager.ReservationManager thread(dd4ab04d) Message: SUCCESS EXITING queue: (ec2)
2012-02-17 04:27:44,598 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(dd4ab04d) Message: Exception caught in ImageFactory
2012-02-17 04:27:44,606 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(dd4ab04d) Message: Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_ec2_Builder.py", line 458, in push_image
    credentials)
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_ec2_Builder.py", line 562, in push_image_snapshot_ec2
    raise ImageFactoryException("No available JEOS for desired OS, verison combination")
ImageFactoryException: No available JEOS for desired OS, verison combination

2012-02-17 04:27:44,606 DEBUG imgfac.BuildJob.BuildJob thread(dd4ab04d) Message: Builder (dd4ab04d-68d3-4023-962c-f08e893181e4) changed status from FAILED to FAILED
Comment 1 wes hayutin 2012-02-22 23:47:04 UTC 
moving version to 1.0.0 .  version = found in version
Comment 3 Hugh Brock 2012-02-23 14:57:51 UTC 
Fedora 16 is not an officially supported guest OS for CloudForms 1.0.0. Clearing the 1.0.0 flag. Ultimately this bug should be against ImageFactory upstream.
Comment 4 Ian McLeod 2012-02-29 16:30:46 UTC 
This bug is actually already fixed in upstream.

Shveta, if you care to, you can verify this by:

git clone git://github.com/aeolusproject/imagefactory.git
cd imagefactory
make rpm

Then install or upgrade to the resulting RPMs (including the jeosconfig RPM for Fedora) and retry your build.

We have not applied these updates to the 1.0.0 release branch because, as Hugh mentions, it is not a supported guest and thus we couldn't justify the risk associated with the change.
Comment 5 Shveta 2012-03-02 05:28:02 UTC 
Followed the steps mentioned above, were able to build and push with F16 template
==================================================

rpm -qa|grep imagefactory
imagefactory-jeosconf-ec2-rhel-1.0.0rc6_43_gb3da487-1.el6.noarch
imagefactory-1.0.0rc6_43_gb3da487-1.el6.noarch
imagefactory-jeosconf-ec2-fedora-1.0.0rc6_43_gb3da487-1.el6.noarch
rubygem-imagefactory-console-0.4.0-1.el6.noarch



========================================================


[root@qe-blade-08 ~]# tail -f /var/log/imagefactory.log
2012-03-02 00:12:15,625 DEBUG paste.httpserver.ThreadPool thread(worker 0) Message: Started new worker 140019993429760: Initial worker pool
2012-03-02 00:12:15,626 DEBUG paste.httpserver.ThreadPool thread(worker 1) Message: Started new worker 140019982939904: Initial worker pool
2012-03-02 00:12:15,627 DEBUG paste.httpserver.ThreadPool thread(worker 2) Message: Started new worker 140019893270272: Initial worker pool
2012-03-02 00:12:15,628 DEBUG paste.httpserver.ThreadPool thread(worker 3) Message: Started new worker 140019972450048: Initial worker pool
2012-03-02 00:12:15,628 DEBUG paste.httpserver.ThreadPool thread(worker 4) Message: Started new worker 140019882780416: Initial worker pool
2012-03-02 00:12:15,628 DEBUG paste.httpserver.ThreadPool thread(worker 5) Message: Started new worker 140019872290560: Initial worker pool
2012-03-02 00:12:15,629 DEBUG paste.httpserver.ThreadPool thread(worker 6) Message: Started new worker 140019861800704: Initial worker pool
2012-03-02 00:12:15,629 DEBUG paste.httpserver.ThreadPool thread(worker 7) Message: Started new worker 140019851310848: Initial worker pool
2012-03-02 00:12:15,630 DEBUG paste.httpserver.ThreadPool thread(worker 8) Message: Started new worker 140019840820992: Initial worker pool
2012-03-02 00:12:15,631 DEBUG paste.httpserver.ThreadPool thread(worker 9) Message: Started new worker 140019289290496: Initial worker pool
2012-03-02 00:17:12,639 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-03-02 00:17:12,706 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-03-02 00:17:12,706 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-03-02 00:17:12,748 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:17:12,748 INFO imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Creating a bucket returned status (500), .
2012-03-02 00:17:12,751 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Setting metadata ({'object_type': 'template', 'uuid': '97477766-e3fc-4224-8d01-5ecb7b9f682f'}) for http://localhost:9090/templates/97477766-e3fc-4224-8d01-5ecb7b9f682f
2012-03-02 00:17:12,833 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:17:12,833 INFO imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Creating a bucket returned status (500), .
2012-03-02 00:17:12,835 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Setting metadata ({'timestamp': '1330665432.84', 'image': 'f7c00d54-6426-11e1-b356-00215e203092', 'object_type': 'build', 'uuid': '9eb16940-789f-4f2d-accf-c8e7a70cba7d'}) for http://localhost:9090/builds/9eb16940-789f-4f2d-accf-c8e7a70cba7d
2012-03-02 00:17:13,745 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 0) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-03-02 00:17:13,747 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(worker 0) Message: Found neither a call-time config nor a config file - doing nothing
2012-03-02 00:17:13,758 DEBUG imgfac.BuildJob.BuildJob thread(4edd04bc) Message: 4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5 for ec2 about to enter None queue...
2012-03-02 00:17:13,759 DEBUG imgfac.BuildJob.BuildJob thread(4edd04bc) Message: Builder (4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5) changed status from NEW to BUILDING
2012-03-02 00:17:13,760 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(4edd04bc) Message: Building Linux for non-upload cloud (ec2)
2012-03-02 00:17:13,762 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(4edd04bc) Message: Storing placeholder object for non upload cloud image
2012-03-02 00:17:13,764 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:17:13,764 INFO imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Creating a bucket returned status (500), .
2012-03-02 00:17:13,766 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Setting metadata ({'object_type': 'template', 'uuid': '97477766-e3fc-4224-8d01-5ecb7b9f682f'}) for http://localhost:9090/templates/97477766-e3fc-4224-8d01-5ecb7b9f682f
2012-03-02 00:17:13,806 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-03-02 00:17:13,851 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:17:13,851 INFO imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Creating a bucket returned status (500), .
2012-03-02 00:17:13,852 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,852 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,853 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,854 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,854 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,854 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Uploading 0kB of 0kB
2012-03-02 00:17:13,854 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Setting metadata ({'icicle': 'none', 'uuid': '4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5', 'template': '97477766-e3fc-4224-8d01-5ecb7b9f682f', 'target_parameters': None, 'object_type': 'target_image', 'target': 'ec2', 'build': '9eb16940-789f-4f2d-accf-c8e7a70cba7d'}) for http://localhost:9090/target_images/4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5
2012-03-02 00:17:13,946 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-03-02 00:17:14,098 DEBUG imgfac.BuildJob.BuildJob thread(4edd04bc) Message: Builder (4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5) changed percent complete from 0 to 100
2012-03-02 00:17:14,098 DEBUG imgfac.BuildJob.BuildJob thread(4edd04bc) Message: Builder (4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5) changed status from BUILDING to COMPLETED
2012-03-02 00:17:14,098 DEBUG imgfac.BuildJob.BuildJob thread(4edd04bc) Message: 4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5 for ec2 about to exit None queue...
2012-03-02 00:17:14,098 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Getting metadata (['latest_unpushed']) from http://localhost:9090/images/f7c00d54-6426-11e1-b356-00215e203092
2012-03-02 00:17:14,099 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Image Warehouse returned status (404) with message: 
2012-03-02 00:17:14,099 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Getting metadata (['latest_build']) from http://localhost:9090/images/f7c00d54-6426-11e1-b356-00215e203092
2012-03-02 00:17:14,101 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Image Warehouse returned status (404) with message: 
2012-03-02 00:17:14,101 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(4edd04bc) Message: Setting metadata ({'latest_unpushed': '9eb16940-789f-4f2d-accf-c8e7a70cba7d'}) for http://localhost:9090/images/f7c00d54-6426-11e1-b356-00215e203092
2012-03-02 00:17:14,103 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(4edd04bc) Message: Completed placeholder warehouse object for linux non-upload image...
2012-03-02 00:17:57,257 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-03-02 00:17:57,301 DEBUG imgfac.BuildDispatcher.BuildDispatcher thread(worker 3) Message: Testing provider for XML: syntax error: line 1, column 0
2012-03-02 00:17:57,302 DEBUG imgfac.BuildDispatcher.BuildDispatcher thread(worker 3) Message: Testing provider for JSON: No JSON object could be decoded
2012-03-02 00:17:57,314 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 3) Message: Querying (http://localhost:9090/target_images/_query) with expression ($build == "9eb16940-789f-4f2d-accf-c8e7a70cba7d" && $target == "ec2")
2012-03-02 00:17:57,355 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 3) Message: Getting metadata (['template']) from http://localhost:9090/target_images/4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5
2012-03-02 00:17:57,357 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 3) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-03-02 00:17:57,364 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(worker 3) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2012-03-02 00:17:57,365 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(worker 3) Message: Found neither a call-time config nor a config file - doing nothing
2012-03-02 00:17:57,391 DEBUG paste.httpserver.ThreadPool thread(MainThread) Message: Added task (0 tasks queued)
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Original URL http://download.fedoraproject.org/pub/fedora/linux/releases/16/Fedora/x86_64/os/ resolved to http://download.fedora.devel.redhat.com/pub/fedora/linux/releases/16/Fedora/x86_64/os/
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Name: factory-build-54f08dcf-5284-409e-a86d-b8dfa360580e, UUID: b043d9bd-5220-472c-a9e0-8d30aaa69359
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: MAC: 52:54:00:54:01:db, distro: Fedora
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: update: 16, arch: x86_64, diskimage: /var/lib/imagefactory/images/factory-build-54f08dcf-5284-409e-a86d-b8dfa360580e.dsk
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: nicmodel: virtio, clockoffset: utc
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: mousetype: ps2, disk_bus: virtio, disk_dev: vda
2012-03-02 00:17:58,269 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: icicletmp: /var/lib/oz/icicletmp/factory-build-54f08dcf-5284-409e-a86d-b8dfa360580e, listen_port: 15437
2012-03-02 00:17:58,270 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Original ISO path: /var/lib/oz/isos/Fedora16x86_64-url.iso
2012-03-02 00:17:58,270 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Modified ISO cache: /var/lib/oz/isos/Fedora16x86_64-url-oz.iso
2012-03-02 00:17:58,270 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Output ISO path: /var/lib/imagefactory/images/factory-build-54f08dcf-5284-409e-a86d-b8dfa360580e-url-oz.iso
2012-03-02 00:17:58,270 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: ISO content path: /var/lib/oz/isocontent/factory-build-54f08dcf-5284-409e-a86d-b8dfa360580e-url
2012-03-02 00:17:58,270 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Being asked to push for provider ec2-us-east-1
2012-03-02 00:17:58,270 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: distro: Fedora - update: 16 - arch: x86_64
2012-03-02 00:17:58,280 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: acting as EC2 user: 8571-4451-8821
2012-03-02 00:17:58,280 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: 54f08dcf-5284-409e-a86d-b8dfa360580e for ec2 about to enter ec2 queue...
2012-03-02 00:17:58,281 DEBUG imgfac.ReservationManager.ReservationManager thread(54f08dcf) Message: ENTERING queue: (ec2)
2012-03-02 00:17:58,281 DEBUG imgfac.ReservationManager.ReservationManager thread(54f08dcf) Message: SUCCESS ENTERING queue: (ec2)
2012-03-02 00:17:58,281 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: Builder (54f08dcf-5284-409e-a86d-b8dfa360580e) changed status from NEW to PUSHING
2012-03-02 00:17:58,281 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: Builder (54f08dcf-5284-409e-a86d-b8dfa360580e) changed percent complete from 0 to 0
2012-03-02 00:17:59,248 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Creating temporary security group (imagefactory-54f08dcf-5284-409e-a86d-b8dfa360580e)
2012-03-02 00:18:00,344 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Starting ami ami-9865b6f1 with instance_type m1.large
2012-03-02 00:18:00,825 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Waiting for EC2 instance to start: 0/300
2012-03-02 00:18:12,506 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Waiting for EC2 instance to start: 10/300
2012-03-02 00:18:21,939 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Waiting for EC2 ssh access: 0/300
2012-03-02 00:19:02,898 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Waiting 20 seconds for remaining boot tasks
2012-03-02 00:19:22,918 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Stopping cron and killing any updatedb process that may be running
2012-03-02 00:19:25,246 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Done
2012-03-02 00:19:25,247 INFO imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Creating cloud-info file indicating target (ec2)
2012-03-02 00:19:26,089 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Customizing guest: ec2-50-17-44-141.compute-1.amazonaws.com
2012-03-02 00:19:26,090 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Installing additional repository files
2012-03-02 00:19:29,569 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Installing custom packages
2012-03-02 00:19:29,569 INFO oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Uploading custom files
2012-03-02 00:19:29,569 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Running custom commands
2012-03-02 00:19:29,570 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Removing non-persisted repos
2012-03-02 00:19:29,570 DEBUG oz.Guest.FedoraRemoteGuest thread(54f08dcf) Message: Syncing
2012-03-02 00:19:30,456 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Customization step complete
2012-03-02 00:19:30,457 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Generating ICICLE from customized guest
2012-03-02 00:19:34,527 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: ICICLE generation complete
2012-03-02 00:19:34,528 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Re-de-activate firstboot just in case it has been revived during customize
2012-03-02 00:19:35,379 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: De-activation complete
2012-03-02 00:19:35,380 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Performing image prep tasks for EBS backed images
2012-03-02 00:19:35,380 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Creating a new EBS backed image from our running EBS instance
2012-03-02 00:19:35,651 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: EUCA creat_image call returned AMI ID: ami-10b16c79
2012-03-02 00:19:35,651 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Now waiting for AMI to become available
2012-03-02 00:19:45,989 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [0 of 1200 seconds elapsed]
2012-03-02 00:19:56,172 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [10 of 1200 seconds elapsed]
2012-03-02 00:20:06,354 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [20 of 1200 seconds elapsed]
2012-03-02 00:20:16,530 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [30 of 1200 seconds elapsed]
2012-03-02 00:20:26,705 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [40 of 1200 seconds elapsed]
2012-03-02 00:20:36,877 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: AMI status (pending) - waiting for 'available' - [50 of 1200 seconds elapsed]
2012-03-02 00:20:47,047 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:20:47,047 INFO imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Creating a bucket returned status (500), .
2012-03-02 00:20:47,051 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Setting metadata ({'object_type': 'icicle', 'uuid': '0a13c0c3-b698-4f34-aa96-10a191b6566e'}) for http://localhost:9090/icicles/0a13c0c3-b698-4f34-aa96-10a191b6566e
2012-03-02 00:20:47,134 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Image Warehouse returned status (500) with message: 
2012-03-02 00:20:47,134 INFO imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Creating a bucket returned status (500), .
2012-03-02 00:20:47,136 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Setting metadata ({'provider_account_identifier': 'AKIAI2KPFDYVZKSRTJMQ', 'target_image': '4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5', 'uuid': '54f08dcf-5284-409e-a86d-b8dfa360580e', 'icicle': '0a13c0c3-b698-4f34-aa96-10a191b6566e', 'target_identifier': u'ami-10b16c79', 'object_type': 'provider_image', 'provider': 'ec2-us-east-1'}) for http://localhost:9090/provider_images/54f08dcf-5284-409e-a86d-b8dfa360580e
2012-03-02 00:20:47,419 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Terminating EC2 instance and deleting temp security group
2012-03-02 00:20:48,016 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [0 of 300 seconds elapsed]
2012-03-02 00:20:53,180 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [5 of 300 seconds elapsed]
2012-03-02 00:20:58,338 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [10 of 300 seconds elapsed]
2012-03-02 00:21:03,534 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [15 of 300 seconds elapsed]
2012-03-02 00:21:08,696 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [20 of 300 seconds elapsed]
2012-03-02 00:21:13,868 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [25 of 300 seconds elapsed]
2012-03-02 00:21:19,034 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [30 of 300 seconds elapsed]
2012-03-02 00:21:24,200 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [35 of 300 seconds elapsed]
2012-03-02 00:21:29,369 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [40 of 300 seconds elapsed]
2012-03-02 00:21:34,532 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [45 of 300 seconds elapsed]
2012-03-02 00:21:39,700 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [50 of 300 seconds elapsed]
2012-03-02 00:21:44,861 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [55 of 300 seconds elapsed]
2012-03-02 00:21:50,036 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [60 of 300 seconds elapsed]
2012-03-02 00:21:55,199 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Instance status (shutting-down) - waiting for 'terminated'. [65 of 300 seconds elapsed]
2012-03-02 00:22:00,747 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Removed temporary security group (imagefactory-54f08dcf-5284-409e-a86d-b8dfa360580e)
2012-03-02 00:22:00,747 DEBUG imgfac.builders.BaseBuilder.Fedora_ec2_Builder thread(54f08dcf) Message: Fedora_ec2_Builder instance 140019894153808 pushed image with uuid 4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5 to provider_image UUID (54f08dcf-5284-409e-a86d-b8dfa360580e) and set metadata: {'provider_account_identifier': 'AKIAI2KPFDYVZKSRTJMQ', 'target_image': '4edd04bc-6bb2-4ccd-9f16-4686ae71f6c5', 'target_identifier': u'ami-10b16c79', 'icicle': '0a13c0c3-b698-4f34-aa96-10a191b6566e', 'provider': 'ec2-us-east-1'}
2012-03-02 00:22:00,747 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: Builder (54f08dcf-5284-409e-a86d-b8dfa360580e) changed percent complete from 0 to 100
2012-03-02 00:22:00,747 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: Builder (54f08dcf-5284-409e-a86d-b8dfa360580e) changed status from PUSHING to COMPLETED
2012-03-02 00:22:00,747 DEBUG imgfac.BuildJob.BuildJob thread(54f08dcf) Message: 54f08dcf-5284-409e-a86d-b8dfa360580e for ec2 about to exit ec2 queue...
2012-03-02 00:22:00,747 DEBUG imgfac.ReservationManager.ReservationManager thread(54f08dcf) Message: EXITING queue: (ec2)
2012-03-02 00:22:00,747 DEBUG imgfac.ReservationManager.ReservationManager thread(54f08dcf) Message: SUCCESS EXITING queue: (ec2)
2012-03-02 00:22:00,748 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Setting metadata ({'latest_build': '9eb16940-789f-4f2d-accf-c8e7a70cba7d'}) for http://localhost:9090/images/f7c00d54-6426-11e1-b356-00215e203092
2012-03-02 00:22:00,750 DEBUG imgfac.ImageWarehouse.ImageWarehouse thread(54f08dcf) Message: Setting metadata ({'latest_unpushed': None}) for http://localhost:9090/images/f7c00d54-6426-11e1-b356-00215e203092