Bug 697478

Summary: Templates, adding package groups to template builds fails @push
Product: [Retired] CloudForms Cloud Engine Reporter: wes hayutin <whayutin>
Component: aeolus-conductorAssignee: Ian McLeod <imcleod>
Status: CLOSED CURRENTRELEASE QA Contact: wes hayutin <whayutin>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 0.3.1CC: akarol, clalance, dajohnso, deltacloud-maint, dgao, morazi, ssachdev
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
URL: http://ec2-72-44-49-7.compute-1.amazonaws.com/conductor/image_factory/templates/3?details_tab=builds
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 684278, 697919    
Attachments:
Description Flags
some logs
none
webui none

Description wes hayutin 2011-04-18 12:28:45 UTC
Description of problem:

recreate:
1. create a template
2. add a package group like.. Java
3. build the template

The template fails to push successfully.  w/o adding any additional packages the templates build successfully.


2011-04-18 08:21:55,360 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3929) Message:              value: ('ssh -i /etc/oz/id_rsa-icicle-gen -o ServerAliveInterval=30 -o StrictHostKeyChecking=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null root.amazonaws.com yum -y install java-1.5.0-gcj java-1.6.0-openjdk java-1.6.0-openjdk-plugin libgcj ' failed(1): Warning: Permanently added 'ec2-50-17-176-205.compute-1.amazonaws.com,10.114.143.27' (RSA) to the list of known hosts.
http://chifac.usersys.redhat.com/repos/f13/repodata/repomd.xml: [Errno 14] PYCURL ERROR 6 - ""
Trying other mirror.
http://chifac.usersys.redhat.com/repos/f13/repodata/filelists.xml.gz: [Errno 14] PYCURL ERROR 6 - ""
Trying other mirror.
Error: failure: repodata/filelists.xml.gz from imgfacsnap: [Errno 256] No more mirrors to try.
)
2011-04-18 08:21:55,361 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3929) Message:          traceback: ['  File "/usr/lib/python2.6/site-packages/imagefactory/builders/FedoraBuilder.py", line 409, in push_image\n    self.push_image_snapshot(image_id, provider, credentials)\n', '  File "/usr/lib/python2.6/site-packages/imagefactory/builders/FedoraBuilder.py", line 570, in push_image_snapshot\n    self.guest.do_customize(guestaddr)\n', '  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 495, in do_customize\n    \'yum -y install %s\' % (packstr))\n', '  File "/usr/lib/python2.6/site-packages/oz/RedHat.py", line 311, in guest_execute_command\n    "root@" + guestaddr, command])\n', '  File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 72, in subprocess_check_output\n    raise OzException.OzException("\'%s\' failed(%d): %s" % (cmd, retcode, stderr))\n']
2011-04-18 08:21:55,361 DEBUG imagefactory.qmfagent.BuildAdaptor.BuildAdaptor pid(3929) Message: Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed status from PUSHING to FAILED



[root@ip-10-80-242-101 ~]# rpm -qa | grep aeolus
aeolus-conductor-doc-0.0.3-6.el6.x86_64
aeolus-conductor-0.0.3-6.el6.x86_64
aeolus-conductor-daemons-0.0.3-6.el6.x86_64
aeolus-configure-2.0.0-8.el6.noarch
[root@ip-10-80-242-101 ~]# rpm -qa | grep imagefactory
imagefactory-0.1.6.2_8_gbcb427d-2.el6.noarch
[root@ip-10-80-242-101 ~]#

Comment 1 wes hayutin 2011-04-18 12:29:35 UTC
Created attachment 492883 [details]
some logs

Comment 2 wes hayutin 2011-04-18 12:30:13 UTC
Created attachment 492884 [details]
webui

screen capture

Comment 3 wes hayutin 2011-04-18 12:36:57 UTC
[root@ip-10-80-242-101 ~]# cat /usr/share/aeolus-conductor/config/image_descriptor_package_repositories.yml
-
  id: fedora13
  name: Fedora
  baseurl: http://download.fedoraproject.org/pub/fedora/linux/releases/13/Fedora/x86_64/os/
  type: xml

-
  id: fedora14
  name: Fedora
  baseurl: http://download.fedoraproject.org/pub/fedora/linux/releases/14/Fedora/x86_64/os/
  type: xml

# you can define multiple repositories, as array, for example:
#
# -
#   id: repo1
#   name: Repo
#   baseurl: url
#   type: xml
#
# -
#   baseurl: https://admin:admin@localhost/pulp/api/
#   yumurl: https://localhost/pulp/repos/
#   type: pulp
[root@ip-10-80-242-101 ~]#

Comment 4 wes hayutin 2011-04-18 12:38:45 UTC
passing to imcleod

Comment 5 Chris Lalancette 2011-04-18 12:41:17 UTC
In the initial comment, you see this:

http://chifac.usersys.redhat.com/repos/f13/repodata/repomd.xml: [Errno 14]
PYCURL ERROR 6 - ""
Trying other mirror.
http://chifac.usersys.redhat.com/repos/f13/repodata/filelists.xml.gz: [Errno
14] PYCURL ERROR 6 - ""
Trying other mirror.
Error: failure: repodata/filelists.xml.gz from imgfacsnap: [Errno 256] No more
mirrors to try.

However, you can see from comment 3 that Wes is using the defaults.  What I think is happening here is that due to an earlier bugfix in Oz, we are resolving the mirrorlist to a specific mirror before launching off a configure job.  However, because the cloud engine is running behind the RedHat firewall, that resolves to an internal RedHat machine.  When we then try to use that live in EC2, it fails because it is not allowed to reach back into the firewall.  I'm not quite sure how to fix both issues at the same time.

Chris Lalancette

Comment 6 wes hayutin 2011-04-19 18:10:10 UTC
Confirmed that building templates from with in the RH firewall.. adding packages and package groups does work.  

This bug is to fix the cloud engine ami, perhaps by using a fedora repository that is accessible outside of the RH firewall.

Comment 7 wes hayutin 2011-04-26 21:30:31 UTC
Builds for Fedora 13 , template "test02"
New Build for  
test02/ec2-x86_64: completed  
ec2-us-east-1: completed  
ec2-us-west-1: completed  


added packages from template: 
crypto-utils distcache httpd httpd-manual java-1.5.0-gcj java-1.6.0-openjdk java-1.6.0-openjdk-plugin libgcj mod_perl mod_python mod_ssl php php-ldap php-mysql squid webalizer 



from instance


Loaded plugins: presto, refresh-packagekit
Setting up Group Process
Installed Groups:
   Base
   Dial-up Networking Support
   Graphical Internet
   Hardware Support
   Java
   Legacy Fonts
   Mail Server
   Network Servers
   Printing Support
   System Tools
   Web Server
Available Groups:
   Administration Tools
   Afrikaans Support
   Albanian Support
   Amazigh Support
   Arabic Support
   Armenian Support
   Assamese Support
   Asturian Support
   Authoring and Publishing
   Azerbaijani Support
   Basque Support
   Belarusian Support
   Bengali Support
   Bhutanese Support
   Books and Guides
   Bosnian Support
   Brazilian Portuguese Support
   Breton Support
   Bulgarian Support
   Catalan Support
   Chichewa Support
   Chinese Support
   Clustering
   Coptic Support
[root@localhost ~]# rpm -qa | grep java
java_cup-0.11a-4.fc13.noarch
java-1.6.0-openjdk-1.6.0.0-50.1.8.7.fc13.x86_64
java-1.5.0-gcj-1.5.0.0-32.fc13.x86_64
tzdata-java-2011b-1.fc13.noarch
java-1.6.0-openjdk-plugin-1.6.0.0-50.1.8.7.fc13.x86_64
[root@localhost ~]# rpm -qa | grep httpd
httpd-manual-2.2.17-1.fc13.1.noarch
httpd-2.2.17-1.fc13.1.x86_64
httpd-tools-2.2.17-1.fc13.1.x86_64
[root@localhost ~]# 



[root@hp-xw8600-01 ~]# rpm -qa | grep conductor
aeolus-conductor-0.2.0-1.el6.x86_64
aeolus-conductor-doc-0.2.0-1.el6.x86_64
aeolus-conductor-daemons-0.2.0-1.el6.x86_64


This fixed working.. but would be nice to have dev pick up the bug

Comment 8 wes hayutin 2011-08-01 19:54:59 UTC
release pending...

Comment 9 wes hayutin 2011-08-01 19:56:48 UTC
release pending...

Comment 11 wes hayutin 2011-12-08 13:52:31 UTC
closing out old bugs

Comment 12 wes hayutin 2011-12-08 14:06:17 UTC
perm close