Bug 719055

Summary: Unable to deploy 32-bit Amazon Images
Product: [Retired] CloudForms Cloud Engine Reporter: Michael Solberg <msolberg>
Component: imagefactoryAssignee: jrd <jrd>
Status: CLOSED CURRENTRELEASE QA Contact: wes hayutin <whayutin>
Severity: high Docs Contact:
Priority: unspecified    
Version: 0.3.1CC: akarol, dajohnso, deltacloud-maint, dgao, slinaber, ssachdev, sseago
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
ss none

Description Michael Solberg 2011-07-05 15:48:12 UTC
Description of problem:

I'm able to deploy 64-bit deployables, but not 32-bit deployables.  The error message I get from condor upon deployment is:

-- Submitter: aeolus.selab.atl.redhat.com : <10.17.12.42:45825> : aeolus.selab.atl.redhat.com
---
001.000:  Request is held.

Hold reason: Create_Instance_Failure: Failed to perform transfer: Server returned nothing (no headers, no data)

Here's my image XML:

<template>
  <name>f14jeos</name>
  <os>
    <name>Fedora</name>
    <version>14</version>
    <arch>i386</arch>
    <install type='url'>
      <url>http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/i386/os/</url>
    </install>
  </os>
  <description>Fedora 14</description>
  <packages>
    <package name='bash'/>
    <package name='kernel'/>
    <package name='grub'/>
  </packages>
</template>

Here's my deployable XML:

<deployable name="Fedora 14">
 <description>This is an example deployment</description>
  <assemblies>
    <assembly name="devel" hwp="i386_small">
      <image id="e3762ff0-fd6f-41b8-80ea-5b62984d319f"/>
    </assembly>
  </assemblies>
</deployable>

Here's my hardware profile:

Properties
Name	Unit	Minimum Value
memory 	MB 	512
cpu 	count 	1
storage 	GB 	10
architecture 	label 	i386 

It matches the t1.micro profile on ec2-us-east.


Version-Release number of selected component (if applicable):
aeolus-conductor-doc-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-configure-2.0.1-0.el6.20110628141215gitb8aaf85.noarch
aeolus-conductor-daemons-0.3.0-0.el6.20110701204941gitd66e27c.noarch
rubygem-aeolus-cli-0.0.1-1.el6.20110701204941gitd66e27c.noarch
aeolus-all-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-conductor-0.3.0-0.el6.20110701204941gitd66e27c.noarch
condor-deltacloud-gahp-7.6.0-5dcloud.el6.x86_64
condor-7.6.0-5dcloud.el6.x86_64
rubygem-deltacloud-client-0.3.1-1.el6.noarch
deltacloud-core-0.3.9999-1308927004.el6.noarch
libdeltacloud-0.9-1.el6.x86_64

How reproducible:
100%

Steps to Reproduce:
1. Use aeolus-image to create the image (works)
2. Use aeolus-image to push the image to ec2 (works)
3. Create a new deployment using the above templates (works)
4. Launch the deployment
  
Actual results:
The deployment's state is set to "Instance Failure" with the error message "Create_Instance_Failure: Failed to perform transfer: Server returned nothing (no headers, no data)"

Here's the long condor output:

PeriodicRemove = false
CommittedSlotTime = 0
Out = "/dev/null"
ImageSize_RAW = 0
NumCkpts_RAW = 0
DeltacloudUsername = "AKIAITTGSCIAZMDPTIYA"
EnteredCurrentStatus = 1309878054
CommittedSuspensionTime = 0
NumSystemHolds = 1
TransferErr = false
NumRestarts = 0
ImageSize = 0
Cmd = "job_Fedora_14_i386_Development_Environment_devel_2"
CurrentHosts = 0
Iwd = "/usr/share/aeolus-conductor"
ReleaseReason = undefined
CumulativeSlotTime = 0
ExecutableSize_RAW = 0
CondorVersion = "$CondorVersion: 7.6.0 Jun 30 2011 $"
RemoteUserCpu = 0.0
NumCkpts = 0
JobStatus = 5
Arguments = ""
RemoteSysCpu = 0.0
OnExitRemove = true
BufferBlockSize = 32768
TransferExecutable = false
ClusterId = 2
In = "/dev/null"
DeltacloudHardwareProfile = "t1.micro"
LocalUserCpu = 0.0
GridResource = "deltacloud http://localhost:3003/api"
MinHosts = 1
Environment = ""
JobUniverse = 9
RequestDisk = DiskUsage
LastRemoteStatusUpdate = 1309878052
RootDir = "/"
NumJobStarts = 0
WantRemoteIO = true
RequestMemory = ceiling(ifThenElse(JobVMMemory =!= undefined,JobVMMemory,ImageSize / 1024.000000))
GlobalJobId = "aeolus.selab.atl.redhat.com#2.0#1309878041"
LocalSysCpu = 0.0
DeltacloudHardwareProfileMemory = "645.12"
PeriodicRelease = false
HoldReasonSubCode = 0
FileSystemDomain = "aeolus.selab.atl.redhat.com"
DiskUsage = 0
CumulativeSuspensionTime = 0
DeltacloudHardwareProfileCpu = "1.0"
TransferOut = false
KillSig = "SIGTERM"
ExecutableSize = 0
GridJobId = "deltacloud d8d84303-a6b0-4c5c-a1b2-b06df844a9e4"
MaxHosts = 1
ServerTime = 1309880782
CoreSize = 0
DeltacloudImageId = "ami-6857ac01"
DiskUsage_RAW = 0
WantClaiming = false
ProcId = 0
Managed = "Schedd"
TransferFiles = "NEVER"
ShouldTransferFiles = "NO"
CommittedTime = 0
TotalSuspensions = 0
Err = "/dev/null"
DeltacloudPasswordFile = "/var/lib/aeolus-conductor/jobs/job_Fedora_14_i386_Development_Environment_devel_2"
HoldReason = "Create_Instance_Failure: Failed to perform transfer: Server returned nothing (no headers, no data)"
RequestCpus = 1
NiceUser = false
RemoteWallClockTime = 0.0
TargetType = "Machine"
PeriodicHold = false
QDate = 1309878041
OnExitHold = false
Rank = 0.0
DeltacloudKeyname = "msolberg-ec2-east_1309563070_key_70024261340880"
ExitBySignal = false
CondorPlatform = "$CondorPlatform: X86_64-RedHat_6.1 $"
HoldReasonCode = 0
JobPrio = 0
DeltacloudHardwareProfileStorage = "160.0"
LastSuspensionTime = 0
CurrentTime = time()
JobNotification = 0
User = "aeolus.atl.redhat.com"
BufferSize = 524288
WantRemoteSyscalls = false
LeaveJobInQueue = false
ExitStatus = 0
CompletionDate = 0
DeltacloudRealmId = "us-east-1a"
MyType = "Job"
Requirements = ( true )
WantCheckpoint = false
Owner = "aeolus"
LastJobStatus = 1
TransferIn = false


Expected results:
Deployment should succeed.

Comment 1 Scott Seago 2011-07-07 00:42:45 UTC
So the issue here is that t1.micro instances are EBS-only, but we're attempting to launch with "instance-store" AMIs, so they fail.

For now, we will either need to explicitly hide/filter micro instances, or find some other way to make sure we don't attempt to launch them, at least until we support building/launching ebs instances in ec2.

We'll come up with a plan for this tomorrow.

Comment 2 Scott Seago 2011-07-07 13:49:40 UTC
Patch posted here:

https://fedorahosted.org/pipermail/aeolus-devel/2011-July/002914.html

For now we're ignoring t1.micro instances in matchmaking. We'll need to revisit this problem once we support EBS-backed images.

Comment 3 Michael Solberg 2011-07-07 13:58:33 UTC
This is fixed with the patch - I'm now able to deploy a 32-bit instance on a m1.small hardware profile.

Comment 4 Scott Seago 2011-07-07 15:48:29 UTC
commit: 2d430fde741dbac63bbd6d189c94328d5a6c15ce

Comment 5 Steve Linabery 2011-07-08 15:36:41 UTC
in fp testing

Comment 6 wes hayutin 2011-07-08 17:29:33 UTC
ec2 i386 deploy works for me..


2011-07-08 12:32:20,316 DEBUG imagefactory.qmfagent.ImageFactoryAgent.ImageFactoryAgent pid(2333) Message: Method called: name = build_image 
 args = {'image': '', 'build': '', 'template': '<template>\n  <name>fedora14_postgres</name>\n  <os>    \n    <name>Fedora</name>    \n    <version>14</version>\n    <arch>x86_64</arch>\n    <install type="url">\n      <url>http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/x86_64/os/</url>\n    </install>\n  </os>\n  <description>Fedora 14 x86_64 with postgres</description>\n  <packages>\n    <package name=\'postgresql-server\'/> \n  </packages>\n</template>\n', 'targets': ['ec2']} 
 handle = <cqmf2.AgentEvent; proxy of <Swig Object of type 'qmf::AgentEvent *' at 0x293be70> > 
 addr = redhat.com:imagefactory:688eb382-5abc-4229-ba22-e78208e2fbab:image_factory 
 subtypes = {} 
 userId = anonymous
2011-07-08 12:32:20,317 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:32:20,399 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'image', 'uuid': 'f68e0900-96b6-4137-b028-bc9aa8bca6e7'}) for http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:32:20,443 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'image': 'f68e0900-96b6-4137-b028-bc9aa8bca6e7', 'object_type': 'build', 'uuid': '05a14e5a-5b48-49ae-b613-831dd08dc619'}) for http://localhost:9090/builds/05a14e5a-5b48-49ae-b613-831dd08dc619
2011-07-08 12:32:20,564 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:32:20,568 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Building Linux for non-upload cloud (ec2)
2011-07-08 12:32:20,574 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Storing placeholder object for non upload cloud image
2011-07-08 12:32:20,580 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:32:20,590 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'template', 'uuid': '793654ee-56ca-4390-be79-042bff68be95'}) for http://localhost:9090/templates/793654ee-56ca-4390-be79-042bff68be95
2011-07-08 12:32:20,673 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'icicle': 'none', 'uuid': '0a3ff185-e1e6-452a-b95c-36a6dd4dfc09', 'template': '793654ee-56ca-4390-be79-042bff68be95', 'target_parameters': None, 'object_type': 'target_image', 'target': 'ec2', 'build': '05a14e5a-5b48-49ae-b613-831dd08dc619'}) for http://localhost:9090/target_images/0a3ff185-e1e6-452a-b95c-36a6dd4dfc09
2011-07-08 12:32:20,917 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 100
2011-07-08 12:32:20,918 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_unpushed']) from http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:32:20,919 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_build']) from http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:32:20,920 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_unpushed': '05a14e5a-5b48-49ae-b613-831dd08dc619'}) for http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:32:20,922 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from NEW to COMPLETED
2011-07-08 12:32:20,922 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Completed placeholder warehouse object for linux non-upload image...




2011-07-08 12:33:12,916 DEBUG imagefactory.qmfagent.ImageFactoryAgent.ImageFactoryAgent pid(2333) Message: Method called: name = push_image 
 args = {'credentials': '<provider_accounts>\n<provider_account>\n<name>wes-us-west-1</name>\n<provider>ec2-us-east-1</provider>\n<provider_type>ec2</provider_type>\n<provider_credentials>\n  <ec2_credentials>\n    <access_key>AKIAJ557U7P7OIHRV2EQ</access_key>\n    <account_number>6735-0069-5950</account_number>\n    <certificate>-----BEGIN CERTIFICATE-----\nMIICeDCCAeGgAwIBAgIGAIMhOJTUMA0GCSqGSIb3DQEBBQUAMFMxCzAJBgNVBAYT\nAlVTMRMwEQYDVQQKEwpBbWF6b24uY29tMQwwCgYDVQQLEwNBV1MxITAfBgNVBAMT\nGEFXUyBMaW1pdGVkLUFzc3VyYW5jZSBDQTAeFw0xMDA0MTkxNDU2MDRaFw0xMTA0\nMTkxNDU2MDRaMFMxCzAJBgNVBAYTAlVTMRMwEQYDVQQKEwpBbWF6b24uY29tMRcw\nFQYDVQQLEw5BV1MtRGV2ZWxvcGVyczEWMBQGA1UEAxMNMTNxb2pvMnhpa3AxMzCB\nnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAhsjKFoUJvEiZLdqALUAyFdDoeBKt\nZcqCRa5459+zp/d4XcykugpLlvcEfuKOrQcmqA08JWEN/4Xj4nIz+HoEtui3KFgg\n2YJ/VImlVeaSn4AGjfLsrEjLHnEBSGgNAJsh53fuEQTga8Y00T2qQ7d/Ebh6OXI3\niRKjY5Bm0d5mqrsCAwEAAaNXMFUwDgYDVR0PAQH/BAQDAgWgMBYGA1UdJQEB/wQM\nMAoGCCsGAQUFBwMCMAwGA1UdEwEB/wQCMAAwHQYDVR0OBBYEFDML4N2PsXn7nurg\n5bXHxMkFVQbLMA0GCSqGSIb3DQEBBQUAA4GBAIUGLc0R3HnEDXlXQMiLfQygqXEv\ndouihRgqCO+LOWb3tJbpk49TkhSFcjO0TJnKMb+XzuAdfswwgXSmwbbvrcDT/OdD\njHbCrLTCBBXIgShKZTrTYOAII5sokU4wg5QS0w9cEWcxceUWRaP8ELdai+ubrlif\noCeB2dgQxL18+uK5\n-----END CERTIFICATE-----\n</certificate>\n    <key>-----BEGIN PRIVATE KEY-----\nMIICdQIBADANBgkqhkiG9w0BAQEFAASCAl8wggJbAgEAAoGBAIbIyhaFCbxImS3agC1AMhXQ6HgS&#xD;\nrWXKgkWueOffs6f3eF3MpLoKS5b3BH7ijq0HJqgNPCVhDf+F4+JyM/h6BLbotyhYINmCf1SJpVXm&#xD;\nkp+ABo3y7KxIyx5xAUhoDQCbIed37hEE4GvGNNE9qkO3fxG4ejlyN4kSo2OQZtHeZqq7AgMBAAEC&#xD;\ngYByI9mXZoRPET++5/mB2IpRlT84Z8C1od/eOJkk63kNtfEVpfadoZhPuNHyzdM7TgH7cHHNybn7&#xD;\n+Jt6KXI/ar1QDIse7S+xU700AWJVaUt3FqlrglmGT018oGWqH1/3D9/4yVsdvxCKcKYuvre3j2gU&#xD;\nsi7uJPpWYqCLhs41EuIUiQJBAPcuRXEtVV5MJipuYljERZHfxT4Yh/b8agfr1dsrHvd4jly9rJnE&#xD;\nIwB3vn0mMS9Fs/f0rUc3RAZRSrsuwYravU8CQQCLl+YDqZOwVfZIkJO2ipWb1xgjVuikLDRTYAXr&#xD;\n0NqbDdeBozAdPNVvicrGpg61J0Un6r5zjnkMFfS6SpM4bFjVAkAuwbz3DLlCTitGCX1nBzGVx3t7&#xD;\nJI7LpLG17+GTRNPlwhND7ckxiQ2J8BzDda8GHyxM8ia4+vZOL6BwSgboajo3AkAsiTjkYDzzXGmn&#xD;\n+yB1c7+JqdVUqQyuHEBRfWhGNSsZnw/rl1HpchgybsbYG/DDURUaSCWdHo52EaczrElODhtFAkAU&#xD;\n95df+umPXSwSzFaSCVVaGm7QlH8yBx8nFHF+yeFPV5QmDWmj59Y9UM6vM4MHtUAdpEhIzzAoI/Et&#xD;\nlMA4EBbB&#xD;\n-----END PRIVATE KEY-----\n</key>\n    <secret_access_key>7COhvBzxrz2agtOPgk3bZM7W3ej9QI/j6WvYiHdg</secret_access_key>\n  </ec2_credentials>\n</provider_credentials>\n</provider_account>\n</provider_accounts>\n', 'image': 'f68e0900-96b6-4137-b028-bc9aa8bca6e7', 'build': '', 'providers': ['ec2-us-east-1']} 
 handle = <cqmf2.AgentEvent; proxy of <Swig Object of type 'qmf::AgentEvent *' at 0x293be70> > 
 addr = redhat.com:imagefactory:688eb382-5abc-4229-ba22-e78208e2fbab:image_factory 
 subtypes = {} 
 userId = anonymous
2011-07-08 12:33:12,916 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_unpushed']) from http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:33:12,917 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Querying (http://localhost:9090/target_images/_query) with expression ($build == "05a14e5a-5b48-49ae-b613-831dd08dc619" && $target == "ec2")
2011-07-08 12:33:12,920 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['template']) from http://localhost:9090/target_images/0a3ff185-e1e6-452a-b95c-36a6dd4dfc09
2011-07-08 12:33:12,921 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:33:12,923 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:33:12,948 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Name: fedora14_postgres, UUID: 39a53b94-f14e-4962-aa95-97943ad9832e
2011-07-08 12:33:12,948 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: MAC: 52:54:00:f8:da:59, distro: Fedora
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: update: 14, arch: x86_64, diskimage: /var/tmp/fedora14_postgres.dsk
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: nicmodel: virtio, clockoffset: utc
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: mousetype: ps2, disk_bus: virtio, disk_dev: vda
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: icicletmp: /var/lib/oz/icicletmp/fedora14_postgres, listen_port: 11481
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Original ISO path: /var/lib/oz/isos/Fedora14x86_64-url.iso
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Modified ISO cache: /var/lib/oz/isos/Fedora14x86_64-url-oz.iso
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Output ISO path: /var/tmp/fedora14_postgres-url-oz.iso
2011-07-08 12:33:12,949 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: ISO content path: /var/lib/oz/isocontent/fedora14_postgres-url
2011-07-08 12:33:14,436 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Original URL http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/x86_64/os/ resolved to http://download.fedora.devel.redhat.com/pub/fedora/linux/releases/14/Fedora/x86_64/os/
2011-07-08 12:33:14,436 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Being asked to push for provider ec2-us-east-1
2011-07-08 12:33:14,436 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: distro: Fedora - update: 14 - arch: x86_64
2011-07-08 12:33:14,438 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: acting as EC2 user: 6735-0069-5950
2011-07-08 12:33:14,439 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from NEW to PUSHING
2011-07-08 12:33:14,439 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 0
2011-07-08 12:33:14,439 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Starting ami ami-d6b946bf with instance_type m1.large
2011-07-08 12:33:16,794 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Creating temporary security group (imagefactory-e013abb2-6b8e-402b-996e-394c80380639)
2011-07-08 12:33:17,885 WARNING boto pid(2333) Message: Error converting code (pending) to int
2011-07-08 12:33:27,896 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 0/300
2011-07-08 12:33:38,120 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 10/300
2011-07-08 12:33:48,214 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 20/300
2011-07-08 12:33:58,314 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 30/300
2011-07-08 12:33:58,430 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting up to 300 seconds for ssh to become available on ec2-50-19-73-211.compute-1.amazonaws.com
2011-07-08 12:33:58,430 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 0/300
2011-07-08 12:34:11,589 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 10/300
2011-07-08 12:34:25,283 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 20/300
2011-07-08 12:34:26,059 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting 20 seconds for remaining boot tasks
2011-07-08 12:34:46,079 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Removing utility package and repo
2011-07-08 12:34:48,868 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Removal complete
2011-07-08 12:34:48,868 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Customizing guest: ec2-50-19-73-211.compute-1.amazonaws.com
2011-07-08 12:34:48,878 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Installing additional repository files
2011-07-08 12:34:48,878 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Installing custom packages
2011-07-08 12:35:06,495 INFO oz.Guest.FedoraRemoteGuest pid(2333) Message: Uploading custom files
2011-07-08 12:35:06,495 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Syncing
2011-07-08 12:35:07,342 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Customization step complete
2011-07-08 12:35:07,342 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Generating ICICLE from customized guest
2011-07-08 12:35:08,709 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: ICICLE generation complete
2011-07-08 12:35:08,709 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Re-de-activate firstboot just in case it has been revived during customize
2011-07-08 12:35:09,452 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: De-activation complete
2011-07-08 12:35:09,453 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Uploading cert material
2011-07-08 12:35:14,747 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Cert upload complete
2011-07-08 12:35:14,748 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing bundle vol command: euca-bundle-vol -c /tmp/tmpbagrXG -k /tmp/tmpdDuiVe -u 6735-0069-5950 -e /mnt,/tmp,/root/.ssh --arch x86_64 -d /mnt/bundles --kernel aki-427d952b -p e013abb2-6b8e-402b-996e-394c80380639 -s 10240 --ec2cert /tmp/cert-ec2.pem --fstab /etc/fstab -v /
2011-07-08 12:38:42,633 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Bundle output: Filesystem label=/
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
655360 inodes, 2621440 blocks
131072 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2684354560
80 block groups
32768 blocks per group, 32768 fragments per group
8192 inodes per group
Superblock backups stored on blocks: 
	32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Writing inode tables: done                            
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 30 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.
Unable to read ramdisk id
Unable to read product codes
Unable to read product codes
['blkid', '-sFS_TYPE', '-ovalue', '/tmp/tmpLxPK99/dev']
['blkid', '-sUUID', '-ovalue', '/tmp/tmpLxPK99/dev']
['blkid', '-sLABEL', '-ovalue', '/tmp/tmpLxPK99/dev']
Warning: rsync reports files partially copied:
('', 'rsync: rsync_xal_clear: lremovexattr("etc/ld.so.conf.d/.libc6-xen.conf.K7fWG2","security.selinux") failed: Permission denied (13)\nrsync: rsync_xal_clear: lremovexattr("etc/sysconfig/.cloud-info.G9u0rs","security.selinux") failed: Permission denied (13)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7]\n')
Checking image
Encrypting image
Splitting image...
Part: e013abb2-6b8e-402b-996e-394c80380639.part.00
Part: e013abb2-6b8e-402b-996e-394c80380639.part.01
Part: e013abb2-6b8e-402b-996e-394c80380639.part.02
Part: e013abb2-6b8e-402b-996e-394c80380639.part.03
Part: e013abb2-6b8e-402b-996e-394c80380639.part.04
Part: e013abb2-6b8e-402b-996e-394c80380639.part.05
Part: e013abb2-6b8e-402b-996e-394c80380639.part.06
Part: e013abb2-6b8e-402b-996e-394c80380639.part.07
Part: e013abb2-6b8e-402b-996e-394c80380639.part.08
Part: e013abb2-6b8e-402b-996e-394c80380639.part.09
Part: e013abb2-6b8e-402b-996e-394c80380639.part.10
Part: e013abb2-6b8e-402b-996e-394c80380639.part.11
Part: e013abb2-6b8e-402b-996e-394c80380639.part.12
Part: e013abb2-6b8e-402b-996e-394c80380639.part.13
Part: e013abb2-6b8e-402b-996e-394c80380639.part.14
Part: e013abb2-6b8e-402b-996e-394c80380639.part.15
Part: e013abb2-6b8e-402b-996e-394c80380639.part.16
Part: e013abb2-6b8e-402b-996e-394c80380639.part.17
Part: e013abb2-6b8e-402b-996e-394c80380639.part.18
Part: e013abb2-6b8e-402b-996e-394c80380639.part.19
Part: e013abb2-6b8e-402b-996e-394c80380639.part.20
Part: e013abb2-6b8e-402b-996e-394c80380639.part.21
Part: e013abb2-6b8e-402b-996e-394c80380639.part.22
Part: e013abb2-6b8e-402b-996e-394c80380639.part.23
Part: e013abb2-6b8e-402b-996e-394c80380639.part.24
Part: e013abb2-6b8e-402b-996e-394c80380639.part.25
Part: e013abb2-6b8e-402b-996e-394c80380639.part.26
Part: e013abb2-6b8e-402b-996e-394c80380639.part.27
Generating manifest /mnt/bundles/e013abb2-6b8e-402b-996e-394c80380639.manifest.xml

2011-07-08 12:38:45,151 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing upload bundle command: euca-upload-bundle -b imagefactory-ec2-us-east-1-6735-0069-5950 -m /mnt/bundles/e013abb2-6b8e-402b-996e-394c80380639.manifest.xml --ec2cert /tmp/cert-ec2.pem -a "<access_key>" -s "<secret_key>" -U http://s3.amazonaws.com/
2011-07-08 12:39:13,795 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Upload output: Checking bucket: imagefactory-ec2-us-east-1-6735-0069-5950
Uploading manifest file
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.00
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.01
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.02
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.03
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.04
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.05
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.06
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.07
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.08
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.09
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.10
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.11
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.12
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.13
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.14
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.15
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.16
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.17
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.18
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.19
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.20
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.21
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.22
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.23
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.24
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.25
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.26
Uploading part: e013abb2-6b8e-402b-996e-394c80380639.part.27
Uploaded image as imagefactory-ec2-us-east-1-6735-0069-5950/e013abb2-6b8e-402b-996e-394c80380639.manifest.xml

2011-07-08 12:39:13,796 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing register command: euca-register -U http://ec2.us-east-1.amazonaws.com/ -A "access_key" -S "secret_key" imagefactory-ec2-us-east-1-6735-0069-5950/e013abb2-6b8e-402b-996e-394c80380639.manifest.xml
2011-07-08 12:39:17,199 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Register output: IMAGE	ami-76956f1f

2011-07-08 12:39:17,200 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Extracted AMI ID: ami-76956f1f 
2011-07-08 12:39:17,204 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'icicle', 'uuid': '1eff031e-16e6-40de-a406-ea885db83ec8'}) for http://localhost:9090/icicles/1eff031e-16e6-40de-a406-ea885db83ec8
2011-07-08 12:39:17,289 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'target_image': '0a3ff185-e1e6-452a-b95c-36a6dd4dfc09', 'uuid': 'e013abb2-6b8e-402b-996e-394c80380639', 'icicle': '1eff031e-16e6-40de-a406-ea885db83ec8', 'target_identifier': 'ami-76956f1f', 'object_type': 'provider_image', 'provider': 'ec2-us-east-1'}) for http://localhost:9090/provider_images/e013abb2-6b8e-402b-996e-394c80380639
2011-07-08 12:39:17,529 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Stopping EC2 instance and deleting temp security group
2011-07-08 12:39:21,141 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: FedoraBuilder instance 44478416 pushed image with uuid 0a3ff185-e1e6-452a-b95c-36a6dd4dfc09 to provider_image UUID (e013abb2-6b8e-402b-996e-394c80380639) and set metadata: {'target_image': '0a3ff185-e1e6-452a-b95c-36a6dd4dfc09', 'target_identifier': 'ami-76956f1f', 'icicle': '1eff031e-16e6-40de-a406-ea885db83ec8', 'provider': 'ec2-us-east-1'}
2011-07-08 12:39:21,141 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 100
2011-07-08 12:39:21,142 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_build': '05a14e5a-5b48-49ae-b613-831dd08dc619'}) for http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:39:21,144 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_unpushed': None}) for http://localhost:9090/images/f68e0900-96b6-4137-b028-bc9aa8bca6e7
2011-07-08 12:39:21,184 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from PUSHING to COMPLETED





2011-07-08 12:40:33,586 DEBUG imagefactory.qmfagent.ImageFactoryAgent.ImageFactoryAgent pid(2333) Message: Method called: name = build_image 
 args = {'image': '', 'build': '', 'template': '<template>\n  <name>fedora14_postgres</name>\n  <os>    \n    <name>Fedora</name>    \n    <version>14</version>\n    <arch>i386</arch>\n    <install type="url">\n      <url>http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/i386/os/</url>\n    </install>\n  </os>\n  <description>Fedora 14 i386 with postgres</description>\n  <packages>\n    <package name=\'postgresql-server\'/> \n  </packages>\n</template>\n', 'targets': ['ec2']} 
 handle = <cqmf2.AgentEvent; proxy of <Swig Object of type 'qmf::AgentEvent *' at 0x293be70> > 
 addr = redhat.com:imagefactory:688eb382-5abc-4229-ba22-e78208e2fbab:image_factory 
 subtypes = {} 
 userId = anonymous
2011-07-08 12:40:33,587 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:40:33,589 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:40:33,593 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'image', 'uuid': '3148970b-b0ac-4b22-876d-fd83c86985e2'}) for http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:40:33,674 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:40:33,676 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'image': '3148970b-b0ac-4b22-876d-fd83c86985e2', 'object_type': 'build', 'uuid': '3c3c2652-6d04-499b-a477-a8392914d59d'}) for http://localhost:9090/builds/3c3c2652-6d04-499b-a477-a8392914d59d
2011-07-08 12:40:33,797 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:40:33,798 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Building Linux for non-upload cloud (ec2)
2011-07-08 12:40:33,800 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Storing placeholder object for non upload cloud image
2011-07-08 12:40:33,802 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:40:33,804 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'template', 'uuid': 'b98e6e61-438c-475d-896a-4b58fa43730b'}) for http://localhost:9090/templates/b98e6e61-438c-475d-896a-4b58fa43730b
2011-07-08 12:40:33,885 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:40:33,887 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'icicle': 'none', 'uuid': 'a91b16af-0e96-48a4-9727-0a03b36ebf10', 'template': 'b98e6e61-438c-475d-896a-4b58fa43730b', 'target_parameters': None, 'object_type': 'target_image', 'target': 'ec2', 'build': '3c3c2652-6d04-499b-a477-a8392914d59d'}) for http://localhost:9090/target_images/a91b16af-0e96-48a4-9727-0a03b36ebf10
2011-07-08 12:40:34,130 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 100
2011-07-08 12:40:34,131 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_unpushed']) from http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:40:34,132 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_build']) from http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:40:34,133 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_unpushed': '3c3c2652-6d04-499b-a477-a8392914d59d'}) for http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:40:34,135 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from NEW to COMPLETED
2011-07-08 12:40:34,135 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Completed placeholder warehouse object for linux non-upload image...
2011-07-08 12:41:01,475 DEBUG imagefactory.qmfagent.ImageFactoryAgent.ImageFactoryAgent pid(2333) Message: Method called: name = push_image 
 args = {'credentials': '<provider_accounts>\n<provider_account>\n<name>wes-us-west-1</name>\n<provider>ec2-us-east-1</provider>\n<provider_type>ec2</provider_type>\n<provider_credentials>\n  <ec2_credentials>\n    <access_key>AKIAJ557U7P7OIHRV2EQ</access_key>\n    <account_number>6735-0069-5950</account_number>\n    <certificate>-----BEGIN CERTIFICATE-----\nMIICeDCCAeGgAwIBAgIGAIMhOJTUMA0GCSqGSIb3DQEBBQUAMFMxCzAJBgNVBAYT\nAlVTMRMwEQYDVQQKEwpBbWF6b24uY29tMQwwCgYDVQQLEwNBV1MxITAfBgNVBAMT\nGEFXUyBMaW1pdGVkLUFzc3VyYW5jZSBDQTAeFw0xMDA0MTkxNDU2MDRaFw0xMTA0\nMTkxNDU2MDRaMFMxCzAJBgNVBAYTAlVTMRMwEQYDVQQKEwpBbWF6b24uY29tMRcw\nFQYDVQQLEw5BV1MtRGV2ZWxvcGVyczEWMBQGA1UEAxMNMTNxb2pvMnhpa3AxMzCB\nnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAhsjKFoUJvEiZLdqALUAyFdDoeBKt\nZcqCRa5459+zp/d4XcykugpLlvcEfuKOrQcmqA08JWEN/4Xj4nIz+HoEtui3KFgg\n2YJ/VImlVeaSn4AGjfLsrEjLHnEBSGgNAJsh53fuEQTga8Y00T2qQ7d/Ebh6OXI3\niRKjY5Bm0d5mqrsCAwEAAaNXMFUwDgYDVR0PAQH/BAQDAgWgMBYGA1UdJQEB/wQM\nMAoGCCsGAQUFBwMCMAwGA1UdEwEB/wQCMAAwHQYDVR0OBBYEFDML4N2PsXn7nurg\n5bXHxMkFVQbLMA0GCSqGSIb3DQEBBQUAA4GBAIUGLc0R3HnEDXlXQMiLfQygqXEv\ndouihRgqCO+LOWb3tJbpk49TkhSFcjO0TJnKMb+XzuAdfswwgXSmwbbvrcDT/OdD\njHbCrLTCBBXIgShKZTrTYOAII5sokU4wg5QS0w9cEWcxceUWRaP8ELdai+ubrlif\noCeB2dgQxL18+uK5\n-----END CERTIFICATE-----\n</certificate>\n    <key>-----BEGIN PRIVATE KEY-----\nMIICdQIBADANBgkqhkiG9w0BAQEFAASCAl8wggJbAgEAAoGBAIbIyhaFCbxImS3agC1AMhXQ6HgS&#xD;\nrWXKgkWueOffs6f3eF3MpLoKS5b3BH7ijq0HJqgNPCVhDf+F4+JyM/h6BLbotyhYINmCf1SJpVXm&#xD;\nkp+ABo3y7KxIyx5xAUhoDQCbIed37hEE4GvGNNE9qkO3fxG4ejlyN4kSo2OQZtHeZqq7AgMBAAEC&#xD;\ngYByI9mXZoRPET++5/mB2IpRlT84Z8C1od/eOJkk63kNtfEVpfadoZhPuNHyzdM7TgH7cHHNybn7&#xD;\n+Jt6KXI/ar1QDIse7S+xU700AWJVaUt3FqlrglmGT018oGWqH1/3D9/4yVsdvxCKcKYuvre3j2gU&#xD;\nsi7uJPpWYqCLhs41EuIUiQJBAPcuRXEtVV5MJipuYljERZHfxT4Yh/b8agfr1dsrHvd4jly9rJnE&#xD;\nIwB3vn0mMS9Fs/f0rUc3RAZRSrsuwYravU8CQQCLl+YDqZOwVfZIkJO2ipWb1xgjVuikLDRTYAXr&#xD;\n0NqbDdeBozAdPNVvicrGpg61J0Un6r5zjnkMFfS6SpM4bFjVAkAuwbz3DLlCTitGCX1nBzGVx3t7&#xD;\nJI7LpLG17+GTRNPlwhND7ckxiQ2J8BzDda8GHyxM8ia4+vZOL6BwSgboajo3AkAsiTjkYDzzXGmn&#xD;\n+yB1c7+JqdVUqQyuHEBRfWhGNSsZnw/rl1HpchgybsbYG/DDURUaSCWdHo52EaczrElODhtFAkAU&#xD;\n95df+umPXSwSzFaSCVVaGm7QlH8yBx8nFHF+yeFPV5QmDWmj59Y9UM6vM4MHtUAdpEhIzzAoI/Et&#xD;\nlMA4EBbB&#xD;\n-----END PRIVATE KEY-----\n</key>\n    <secret_access_key>7COhvBzxrz2agtOPgk3bZM7W3ej9QI/j6WvYiHdg</secret_access_key>\n  </ec2_credentials>\n</provider_credentials>\n</provider_account>\n</provider_accounts>\n', 'image': '3148970b-b0ac-4b22-876d-fd83c86985e2', 'build': '', 'providers': ['ec2-us-east-1']} 
 handle = <cqmf2.AgentEvent; proxy of <Swig Object of type 'qmf::AgentEvent *' at 0x293be70> > 
 addr = redhat.com:imagefactory:688eb382-5abc-4229-ba22-e78208e2fbab:image_factory 
 subtypes = {} 
 userId = anonymous
2011-07-08 12:41:01,475 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['latest_unpushed']) from http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:41:01,476 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Querying (http://localhost:9090/target_images/_query) with expression ($build == "3c3c2652-6d04-499b-a477-a8392914d59d" && $target == "ec2")
2011-07-08 12:41:01,484 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Getting metadata (['template']) from http://localhost:9090/target_images/a91b16af-0e96-48a4-9727-0a03b36ebf10
2011-07-08 12:41:01,485 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:41:01,487 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Created Image Warehouse instance http://localhost:9090 - buckets(target_images, templates, icicles, provider_images)
2011-07-08 12:41:01,489 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Name: fedora14_postgres, UUID: 30142a4a-7b43-42e8-88d9-d31ee1b19e6a
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: MAC: 52:54:00:6a:53:6f, distro: Fedora
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: update: 14, arch: i386, diskimage: /var/tmp/fedora14_postgres.dsk
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: nicmodel: virtio, clockoffset: utc
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: mousetype: ps2, disk_bus: virtio, disk_dev: vda
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: icicletmp: /var/lib/oz/icicletmp/fedora14_postgres, listen_port: 33640
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Original ISO path: /var/lib/oz/isos/Fedora14i386-url.iso
2011-07-08 12:41:01,490 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Modified ISO cache: /var/lib/oz/isos/Fedora14i386-url-oz.iso
2011-07-08 12:41:01,491 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Output ISO path: /var/tmp/fedora14_postgres-url-oz.iso
2011-07-08 12:41:01,491 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: ISO content path: /var/lib/oz/isocontent/fedora14_postgres-url
2011-07-08 12:41:01,951 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Original URL http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/i386/os/ resolved to http://download.fedora.devel.redhat.com/pub/fedora/linux/releases/14/Fedora/i386/os/
2011-07-08 12:41:01,951 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Being asked to push for provider ec2-us-east-1
2011-07-08 12:41:01,951 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: distro: Fedora - update: 14 - arch: i386
2011-07-08 12:41:01,952 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: acting as EC2 user: 6735-0069-5950
2011-07-08 12:41:01,953 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from NEW to PUSHING
2011-07-08 12:41:01,953 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 0
2011-07-08 12:41:01,953 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Starting ami ami-6ab94603 with instance_type m1.small
2011-07-08 12:41:02,192 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Creating temporary security group (imagefactory-77ef6061-d540-479d-a116-2ad942cf4e2e)
2011-07-08 12:41:03,119 WARNING boto pid(2333) Message: Error converting code (pending) to int
2011-07-08 12:41:13,129 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 0/300
2011-07-08 12:41:23,269 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 10/300
2011-07-08 12:41:33,367 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 20/300
2011-07-08 12:41:43,491 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 30/300
2011-07-08 12:41:53,601 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 instance to start: 40/300
2011-07-08 12:41:53,751 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting up to 300 seconds for ssh to become available on ec2-107-20-23-245.compute-1.amazonaws.com
2011-07-08 12:41:53,751 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 0/300
2011-07-08 12:42:15,840 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 10/300
2011-07-08 12:42:26,945 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting for EC2 ssh access: 20/300
2011-07-08 12:42:29,157 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Waiting 20 seconds for remaining boot tasks
2011-07-08 12:42:49,178 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Removing utility package and repo
2011-07-08 12:42:54,819 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Removal complete
2011-07-08 12:42:54,820 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Customizing guest: ec2-107-20-23-245.compute-1.amazonaws.com
2011-07-08 12:42:54,820 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Installing additional repository files
2011-07-08 12:42:54,820 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Installing custom packages
2011-07-08 12:43:37,918 INFO oz.Guest.FedoraRemoteGuest pid(2333) Message: Uploading custom files
2011-07-08 12:43:37,918 DEBUG oz.Guest.FedoraRemoteGuest pid(2333) Message: Syncing
2011-07-08 12:43:39,653 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Customization step complete
2011-07-08 12:43:39,654 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Generating ICICLE from customized guest
2011-07-08 12:43:42,740 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: ICICLE generation complete
2011-07-08 12:43:42,740 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Re-de-activate firstboot just in case it has been revived during customize
2011-07-08 12:43:44,359 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: De-activation complete
2011-07-08 12:43:44,359 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Uploading cert material
2011-07-08 12:43:52,283 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Cert upload complete
2011-07-08 12:43:52,284 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing bundle vol command: euca-bundle-vol -c /tmp/tmpgaIInX -k /tmp/tmpQjZIuB -u 6735-0069-5950 -e /mnt,/tmp,/root/.ssh --arch i386 -d /mnt/bundles --kernel aki-407d9529 -p 77ef6061-d540-479d-a116-2ad942cf4e2e -s 10240 --ec2cert /tmp/cert-ec2.pem --fstab /etc/fstab -v /



2011-07-08 12:55:25,348 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Bundle output: Filesystem label=/
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
655360 inodes, 2621440 blocks
131072 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2684354560
80 block groups
32768 blocks per group, 32768 fragments per group
8192 inodes per group
Superblock backups stored on blocks: 
	32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Writing inode tables: done                            
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 34 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.
Unable to read ramdisk id
Unable to read product codes
Unable to read product codes
['blkid', '-sFS_TYPE', '-ovalue', '/tmp/tmpZucy8y/dev']
['blkid', '-sUUID', '-ovalue', '/tmp/tmpZucy8y/dev']
['blkid', '-sLABEL', '-ovalue', '/tmp/tmpZucy8y/dev']
Warning: rsync reports files partially copied:
('', 'rsync: rsync_xal_clear: lremovexattr("etc/ld.so.conf.d/.libc6-xen.conf.6ORRPl","security.selinux") failed: Permission denied (13)\nrsync: rsync_xal_clear: lremovexattr("etc/sysconfig/.cloud-info.JjFnhi","security.selinux") failed: Permission denied (13)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7]\n')
Checking image
Encrypting image
Splitting image...
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.00
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.01
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.02
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.03
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.04
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.05
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.06
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.07
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.08
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.09
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.10
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.11
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.12
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.13
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.14
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.15
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.16
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.17
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.18
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.19
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.20
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.21
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.22
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.23
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.24
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.25
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.26
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.27
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.28
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.29
Part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.30
Generating manifest /mnt/bundles/77ef6061-d540-479d-a116-2ad942cf4e2e.manifest.xml

2011-07-08 12:55:27,909 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing upload bundle command: euca-upload-bundle -b imagefactory-ec2-us-east-1-6735-0069-5950 -m /mnt/bundles/77ef6061-d540-479d-a116-2ad942cf4e2e.manifest.xml --ec2cert /tmp/cert-ec2.pem -a "<access_key>" -s "<secret_key>" -U http://s3.amazonaws.com/
2011-07-08 12:55:53,336 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Upload output: Checking bucket: imagefactory-ec2-us-east-1-6735-0069-5950
Uploading manifest file
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.00
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.01
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.02
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.03
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.04
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.05
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.06
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.07
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.08
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.09
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.10
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.11
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.12
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.13
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.14
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.15
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.16
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.17
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.18
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.19
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.20
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.21
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.22
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.23
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.24
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.25
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.26
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.27
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.28
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.29
Uploading part: 77ef6061-d540-479d-a116-2ad942cf4e2e.part.30
Uploaded image as imagefactory-ec2-us-east-1-6735-0069-5950/77ef6061-d540-479d-a116-2ad942cf4e2e.manifest.xml

2011-07-08 12:55:53,337 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Executing register command: euca-register -U http://ec2.us-east-1.amazonaws.com/ -A "access_key" -S "secret_key" imagefactory-ec2-us-east-1-6735-0069-5950/77ef6061-d540-479d-a116-2ad942cf4e2e.manifest.xml
2011-07-08 12:55:55,026 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Register output: IMAGE	ami-22956f4b

2011-07-08 12:55:55,026 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Extracted AMI ID: ami-22956f4b 
2011-07-08 12:55:55,028 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:55:55,031 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'object_type': 'icicle', 'uuid': 'def2b1e5-3410-4283-ad8d-bd3b6ba76e79'}) for http://localhost:9090/icicles/def2b1e5-3410-4283-ad8d-bd3b6ba76e79
2011-07-08 12:55:55,113 INFO imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Creating a bucket returned status 500.  If only iwhd would provide a sane way to know if a bucket exists so we wouldn't have to try and create one every time...
2011-07-08 12:55:55,115 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'target_image': 'a91b16af-0e96-48a4-9727-0a03b36ebf10', 'uuid': '77ef6061-d540-479d-a116-2ad942cf4e2e', 'icicle': 'def2b1e5-3410-4283-ad8d-bd3b6ba76e79', 'target_identifier': 'ami-22956f4b', 'object_type': 'provider_image', 'provider': 'ec2-us-east-1'}) for http://localhost:9090/provider_images/77ef6061-d540-479d-a116-2ad942cf4e2e
2011-07-08 12:55:55,355 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: Stopping EC2 instance and deleting temp security group
2011-07-08 12:55:56,032 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(2333) Message: FedoraBuilder instance 140144850496848 pushed image with uuid a91b16af-0e96-48a4-9727-0a03b36ebf10 to provider_image UUID (77ef6061-d540-479d-a116-2ad942cf4e2e) and set metadata: {'target_image': 'a91b16af-0e96-48a4-9727-0a03b36ebf10', 'target_identifier': 'ami-22956f4b', 'icicle': 'def2b1e5-3410-4283-ad8d-bd3b6ba76e79', 'provider': 'ec2-us-east-1'}
2011-07-08 12:55:56,032 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed percent complete from 0 to 100
2011-07-08 12:55:56,033 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_build': '3c3c2652-6d04-499b-a477-a8392914d59d'}) for http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:55:56,035 DEBUG imagefactory.ImageWarehouse.ImageWarehouse pid(2333) Message: Setting metadata ({'latest_unpushed': None}) for http://localhost:9090/images/3148970b-b0ac-4b22-876d-fd83c86985e2
2011-07-08 12:55:56,075 DEBUG imagefactory.BuildJob.BuildAdaptor pid(2333) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from PUSHING to COMPLETED

[whayutin@minidoe xchatlogs]$ ssh -i ~/Downloads/i386_01_frontend_rsa_1310145942.58546.pem root.amazonaws.com
[root@localhost ~]# 
[root@localhost ~]# 
[root@localhost ~]# uname -a
Linux localhost.localdomain 2.6.35.12-88.fc14.i686.PAE #1 SMP Thu Mar 31 21:54:35 UTC 2011 i686 i686 i386 GNU/Linux
[root@localhost ~]# 
[root@localhost ~]# cat /etc/redhat-release 
Fedora release 14 (Laughlin)

Comment 7 wes hayutin 2011-07-08 17:30:38 UTC
Created attachment 511970 [details]
ss

Comment 8 wes hayutin 2011-07-11 00:30:28 UTC
removing from tracker

Comment 9 wes hayutin 2011-08-01 20:02:21 UTC
release pending...

Comment 10 wes hayutin 2011-08-01 20:02:34 UTC
release pending 3

Comment 11 wes hayutin 2011-08-01 20:02:45 UTC
release pending...

Comment 12 wes hayutin 2011-08-01 20:02:50 UTC
release pending.. 2

Comment 14 wes hayutin 2011-12-08 14:01:59 UTC
perm close

Comment 15 wes hayutin 2011-12-08 14:04:56 UTC
closing out old bugs