Created attachment 961790 [details]
The jboss error
Description of problem:
When installing hosted engine on RHEVH3.5 over el7 with hosted engine based on Centos 7.
After running engine-setup on centos 7 ,
https://192.168.122.10/ovirt-engine/api produces 500 error
Version-Release number of selected component (if applicable):
Ovirt node 3.5
100% (3 out of 3)
Steps to Reproduce:
Names and definitions:
<hosted engine ip> please choose free ip to hold the engine.
<hosted engine iname> the DNS name that will be connected to the mentioned before ip
RHEVH install image with hosted engine plugin.
Centos 7 install image Download - CentOS Wiki
Be familiar with using SSH to connect the RHEVH
Be familiar with the F2 option in RHEVH (Rescue shell)
Setting the RHEVH
Install RHEVH , if installing on virtual machine make sure nested virtualization is enabled and cpu configuration is copied from the hosting machine
Setup networking and security pages to allow ssh connection
Login using ssh into the RHEVH machine - ip can be found in the status page.
Create local DNS resolving for engine if you dont have real DNS server.
add the <hosted eng ip> <hosted engine name> (for example 192.168.122.12 my-engine.com )
Or create real DNS entry in your DNS
Setting NFS server
Install nfs server on the desired computer. (yum install nfs)
Allow nfs , mountd , rpc-bind accss in you firewall
start the nfs server and observe for errors.
Using the /etc/exports file allow access for the network segment with the RHEVH and Engine will be located.
systemctl start nfs
in RHEVH console test the NFS server is available using showmount -e <nfs server ip>
Setting the http server
Install the httpd server ( yum install httpd )
Allow httpd in firewall.
Upload the Centos7 iso into the httpd root directory.
The httpd root directory can be found in /etc/httpd/conf/httpd.conf under DocumentRoot tag most likely (/var/www/html)
systemctl start httpd
in RHEVH console download some file from the httpd server using wget
Installing hosted engine in RHEVH
In the hosted engine page provide the path to the iso located on the http server
run the setup
setup will fail on installation media
re run setup
using remote viewer login into <rhevh ip>:5900 , the password for the login is on the ssh console.
Setting up Centos 7 machine:
Install the machine from iso.
In the network tab please set the Ethernet connection , set the host name to <hosted engine ip> and the static ip to <hosted engine ip>
In RHEVH setup console
Select 1 (continue setup - VM installation is complete)
Make new RHEVH ssh session.
Continue engine setup in Centos7 (The guest VM )
Connect back to Centos machine like in previous step or by ssh connection
and run ifconfig to verify <hosted engine ip>
install ovirt repositories
yum localinstall http://resources.ovirt.org/pub/yum-repo/ovirt-release35.rpm
yum localinstall http://resources.ovirt.org/pub/yum-repo/ovirt-release35-snapshot.rpm
yum install ovirt-engine
run engine-setup as root when failed re run .
From external pc please make sure you can login to the engine.
In RHEVH console with setup
Select 1 to complete install.
The hosted engine setup complains about 500 error , after some invetigation and puttin it the https://192.168.122.10/ovirt-engine/api
Error 500 was observed all logs attached.
Expected the setup to finish succefully
Created attachment 961791 [details]
hosted engine setup log
Created attachment 961792 [details]
hosted engine setup answers
Created attachment 961803 [details]
first failed engine setup
Created attachment 961804 [details]
first fail engine setup conf
Created attachment 961805 [details]
second succefull engine setup
Created attachment 961806 [details]
second succefull engine setup conf
Could you please provided the engine.log, server.log and others on /var/log/ovirt-engine/ ?
Created attachment 961889 [details]
ovirt engine log from ceperate centos install)
Created attachment 961890 [details]
ovirt engine server log from seperate centos7 install
The bug can also be reproduced by instaling ovirt-engine over plain centos7 and accesing it from http://<server>/ovirt-engine/api
If needed have one installed and can share it over net.
This is the relevant error message from server.log:
Caused by: java.lang.ClassNotFoundException: org.apache.avalon.framework.configuration.ConfigurationException from [Module "org.apache.xmlgraphics.fop:main" from local module loader @516e9cbe (roots: /var/lib/ovirt-engine/jboss_runtime/modules/00-ovirt-engine-modules,/var/lib/ovirt-engine/jboss_runtime/modules/01-ovirt-engine-jboss-as-modules)]
... 31 more
It means that the Avalon Framework module isn't defined correctly. It isn't because in RHEL6 and CentOS 6 it contains a single .jar file, but in Fedora it contains two files. We tweaked the .spec to take care of this difference, but didn't take into account that this tweak doesn't work for RHEL7 or CentOS7.
To workaround the issue you can do the following:
# cd /usr/share/ovirt-engine/modules/org/apache/avalon/framework/main
# ln -sf /usr/share/java/avalon-framework-api.jar .
# ln -sf /usr/share/java/avalon-framework-impl.jar .
# systemctl restart ovirt-engine
Just to be sure, is this issue only occuring when installing a hosted engine on RHEVH3.5 over el7 with a hosted engine based on Centos 7? Has anyone tried other scenarios?
Regarding comment 10, is this also happening when installing the engine over el7?
This happened when installing the engine on EL7 (RHEL7 or Centos7), no matter if it is hosted engine or plain vanilla engine.
To verify this bug properly also in RHEVM, we need RHEL7 support for it, which is planned in RHEVM 3.6, according to RFE bug 920126.
Juan, is it possible to re-target this bug also to 3.6? Because until then QA cannot verify it.
This is a question for Sandro, but my understanding is that this must be targeted for 3.5.0 because we want EL7 support in ovirt-engine 3.5.1.
Just to clarify, oVirt is meant to support EL7 in 3.5.1 using ovirt-engine-jboss-as.
We're not supposed to verify this bug in RHEV-M 3.5. RFE bug 920126 is not yet approved so it may not make it for 3.6.
This has been verified upstream oVirt with verions:
ovirt-engine-3.5.1-0.0.master.20150107061804.git447ff70.el7.centos.noarch on rhel 7.1.
(In reply to Sandro Bonazzola from comment #16)
> Just to clarify, oVirt is meant to support EL7 in 3.5.1 using
> We're not supposed to verify this bug in RHEV-M 3.5. RFE bug 920126 is not
> yet approved so it may not make it for 3.6.
Thanks for clarification. I am then removing depending bug 920126, because it's not relevant for oVirt.
And cloning this bug to RHEVM product, so we have tracker for further testing once bug 920126 is solved.