Bug 785159

Summary:	upload and build alll for a simple template is failing
Product:	[Retired] CloudForms Cloud Engine	Reporter:	wes hayutin <whayutin>
Component:	aeolus-conductor	Assignee:	Angus Thomas <athomas>
Status:	CLOSED NOTABUG	QA Contact:	wes hayutin <whayutin>
Severity:	low	Docs Contact:
Priority:	unspecified
Version:	1.0.0	CC:	akarol, deltacloud-maint, ssachdev
Target Milestone:	rc	Keywords:	Regression
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
URL:	https://qeblade31.rhq.lab.eng.bos.redhat.com/conductor/images/05e18a90-48eb-11e1-98fd-5cf3fc217780
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2012-01-27 13:44:21 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Bug Depends On:
Bug Blocks:	744194

Description wes hayutin 2012-01-27 13:36:26 UTC

Description of problem:

recreate:
1. setup vsphere, rhevm, ec2 providers
2. upload the following template via the webui
3. nav to conductor/images
4. click build all


<template>
<script/>
<name>basicRHEL62</name>
<os>
<name>RHEL-6</name>
<version>2</version>
<arch>x86_64</arch>
<rootpw>asdfat</rootpw>
<install type="url">
<url>
http://download.devel.redhat.com/released/RHEL-6-Server/6.2/x86_64/os/
</url>
</install>
</os>
<description>RHEL62 x86_64</description>
</template>


12-01-27 08:31:16,439 INFO imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Creating a bucket returned status (500), .
2012-01-27 08:31:16,440 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,440 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,441 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,442 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,442 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,442 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,443 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Setting metadata ({'icicle': 'none', 'uuid': '24b51380-ddbb-4c47-9cf1-81a5dd66a792', 'template': 'f4fa0261-9363-4638-9149-2bafdbecdf8f', 'target_parameters': None, 'object_type': 'target_image', 'target': 'ec2', 'build': 'c154de19-b0b3-4188-b883-5a44802b710e'}) for http://localhost:9090/target_images/24b51380-ddbb-4c47-9cf1-81a5dd66a792
2012-01-27 08:31:16,444 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Image Warehouse returned status (500) with message: 
2012-01-27 08:31:16,444 INFO imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Creating a bucket returned status (500), .
2012-01-27 08:31:16,447 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Setting metadata ({'object_type': 'icicle', 'uuid': '8fc6c943-c528-4876-857b-40eed37758e0'}) for http://localhost:9090/icicles/8fc6c943-c528-4876-857b-40eed37758e0
2012-01-27 08:31:16,533 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Image Warehouse returned status (500) with message: 
2012-01-27 08:31:16,533 INFO imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Creating a bucket returned status (500), .
2012-01-27 08:31:16,534 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,535 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,535 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,536 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,536 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,536 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Uploading 0kB of 0kB
2012-01-27 08:31:16,536 DEBUG imgfac.ImageWarehouse.ImageWarehouse pid(2295) Message: Setting metadata ({'icicle': '8fc6c943-c528-4876-857b-40eed37758e0', 'uuid': '9546b3f0-7fce-4552-84de-f5d881cb0ef3', 'template': 'f4fa0261-9363-4638-9149-2bafdbecdf8f', 'target_parameters': None, 'object_type': 'target_image', 'target': 'mock', 'build': 'c154de19-b0b3-4188-b883-5a44802b710e'}) for http://localhost:9090/target_images/9546b3f0-7fce-4552-84de-f5d881cb0ef3
2012-01-27 08:31:16,601 DEBUG oz.Guest.RHEL6Guest pid(2295) Message: Libvirt type is kvm
2012-01-27 08:31:16,694 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: Builder (24b51380-ddbb-4c47-9cf1-81a5dd66a792) changed percent complete from 0 to 100
2012-01-27 08:31:16,694 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: Builder (24b51380-ddbb-4c47-9cf1-81a5dd66a792) changed status from BUILDING to COMPLETED
2012-01-27 08:31:16,695 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: 24b51380-ddbb-4c47-9cf1-81a5dd66a792 for ec2 about to exit None queue...
2012-01-27 08:31:16,695 DEBUG imgfac.builders.BaseBuilder.RHEL6_ec2_Builder pid(2295) Message: Completed placeholder warehouse object for linux non-upload image...
2012-01-27 08:31:16,762 DEBUG imgfac.builders.BaseBuilder.RHEL6_vsphere_Builder pid(2295) Message: Exception caught in ImageFactory
2012-01-27 08:31:16,790 DEBUG imgfac.builders.BaseBuilder.RHEL6_vsphere_Builder pid(2295) Message: Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_vsphere_Builder.py", line 49, in build_image
    self.build_upload(build_id)
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_vsphere_Builder.py", line 83, in build_upload
    self.guest = oz.GuestFactory.guest_factory(self.tdlobj, oz_config, None)
  File "/usr/lib/python2.6/site-packages/oz/GuestFactory.py", line 69, in guest_factory
    klass = oz.RHEL_6.get_class(tdl, config, auto, output_disk)
  File "/usr/lib/python2.6/site-packages/oz/RHEL_6.py", line 57, in get_class
    return RHEL6Guest(tdl, config, auto, output_disk)
  File "/usr/lib/python2.6/site-packages/oz/RHEL_6.py", line 35, in __init__
    "cpio")
  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 42, in __init__
    None, None, diskbus, iso_allowed, url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1151, in __init__
    mousetype, diskbus, iso_allowed, url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 203, in __init__
    self.url = self._check_url(iso=iso_allowed, url=url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 809, in _check_url
    response = urllib2.urlopen(url)
  File "/usr/lib64/python2.6/urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "/usr/lib64/python2.6/urllib2.py", line 397, in open
    response = meth(req, response)
  File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib64/python2.6/urllib2.py", line 435, in error
    return self._call_chain(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 404: Not Found

2012-01-27 08:31:16,790 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: Builder (0d1e9a7e-388c-4ce3-ace6-8e6bd8121aca) changed status from BUILDING to FAILED
2012-01-27 08:31:16,791 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: 0d1e9a7e-388c-4ce3-ace6-8e6bd8121aca for vsphere about to exit local queue...
2012-01-27 08:31:16,791 DEBUG imgfac.ReservationManager.ReservationManager pid(2295) Message: EXITING queue: (local)
2012-01-27 08:31:16,791 DEBUG imgfac.ReservationManager.ReservationManager pid(2295) Message: SUCCESS EXITING queue: (local)
2012-01-27 08:31:16,816 DEBUG oz.Guest.RHEL6Guest pid(2295) Message: Libvirt type is kvm
2012-01-27 08:31:16,933 DEBUG imgfac.builders.BaseBuilder.RHEL6_rhevm_Builder pid(2295) Message: Exception caught in ImageFactory
2012-01-27 08:31:16,940 DEBUG imgfac.builders.BaseBuilder.RHEL6_rhevm_Builder pid(2295) Message: Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_rhevm_Builder.py", line 65, in build_image
    self.build_upload(build_id)
  File "/usr/lib/python2.6/site-packages/imgfac/builders/Fedora_rhevm_Builder.py", line 92, in build_upload
    guest = oz.GuestFactory.guest_factory(self.tdlobj, oz_config, None)
  File "/usr/lib/python2.6/site-packages/oz/GuestFactory.py", line 69, in guest_factory
    klass = oz.RHEL_6.get_class(tdl, config, auto, output_disk)
  File "/usr/lib/python2.6/site-packages/oz/RHEL_6.py", line 57, in get_class
    return RHEL6Guest(tdl, config, auto, output_disk)
  File "/usr/lib/python2.6/site-packages/oz/RHEL_6.py", line 35, in __init__
    "cpio")
  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 42, in __init__
    None, None, diskbus, iso_allowed, url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1151, in __init__
    mousetype, diskbus, iso_allowed, url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 203, in __init__
    self.url = self._check_url(iso=iso_allowed, url=url_allowed)
  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 809, in _check_url
    response = urllib2.urlopen(url)
  File "/usr/lib64/python2.6/urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "/usr/lib64/python2.6/urllib2.py", line 397, in open
    response = meth(req, response)
  File "/usr/lib64/python2.6/urllib2.py", line 510, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib64/python2.6/urllib2.py", line 435, in error
    return self._call_chain(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 404: Not Found

2012-01-27 08:31:16,940 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: Builder (8dd8c088-cf86-4f19-bfe0-c8ed0d8b18ee) changed status from BUILDING to FAILED
2012-01-27 08:31:16,940 DEBUG imgfac.BuildJob.BuildJob pid(2295) Message: 8dd8c088-cf86-4f19-bfe0-c8ed0d8b18ee for rhevm about to exit local queue...
2012-01-27 08:31:16,940 DEBUG imgfac.ReservationManager.ReservationManager pid(2295) Message: EXITING queue: (local)
2012-01-27 08:31:16,940 DEBUG imgfac.ReservationManager.ReservationManager pid(2295) Message: SUCCESS EXITING queue: (local)
2012-01-27 08:31:17,031 DEBUG paste.httpserver.ThreadPool pid(2295) Message: Added task (0 tasks queued)

Comment 1 wes hayutin 2012-01-27 13:41:09 UTC

same failed result w/ 

[root@qeblade31 ~]# aeolus image build --target ec2,rhevm,vsphere --template RHEL62.tpl 
Image                                    Build                                    Target Image                             Target      Status       
------------------------------------     ------------------------------------     ------------------------------------     -------     --------     
152fdad4-4682-4861-9fc7-d1531cce6c2d     33e654f9-a070-4135-8734-d261a7ef5d92     44cf004e-1293-4b75-b0a5-44c9ae8bf582     ec2         BUILDING     
152fdad4-4682-4861-9fc7-d1531cce6c2d     33e654f9-a070-4135-8734-d261a7ef5d92     6a41083d-7cc9-4907-925c-5f236118e506     rhevm       BUILDING     
152fdad4-4682-4861-9fc7-d1531cce6c2d     33e654f9-a070-4135-8734-d261a7ef5d92     daffe681-860e-4287-92d2-461c8cc6fbd8     vsphere     BUILDING

Comment 2 wes hayutin 2012-01-27 13:47:27 UTC

thats a legit 404 error, not a bug