Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1454620

Summary: Spacewalk start fails after fresh install with java-errors
Product: [Community] Spacewalk Reporter: Thomas Schweikle <tschweikle>
Component: ServerAssignee: Tomáš Kašpárek <tkasparek>
Status: CLOSED CURRENTRELEASE QA Contact: Red Hat Satellite QA List <satqe-list>
Severity: high Docs Contact:
Priority: unspecified    
Version: 2.6CC: linuxraja, mmraka
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: spacewalk-java-2.7.53-1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-09-27 07:04:11 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1484117    
Attachments:
Description Flags
spacewalk-debug output none

Description Thomas Schweikle 2017-05-23 08:06:29 UTC 
Created attachment 1281360 [details]
spacewalk-debug output

Description of problem:
After a fresh install of Spacewalk 2.6 on RHEL7 based distributions (CentOS, OracleLinux, Scientific Linux) spacewalk java fails with:

STATUS | wrapper  | 2017/05/22 17:06:52 | --> Wrapper Started as Daemon
STATUS | wrapper  | 2017/05/22 17:06:52 | Launching a JVM...
INFO   | jvm 1    | 2017/05/22 17:06:53 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 1    | 2017/05/22 17:06:53 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 1    | 2017/05/22 17:06:53 |
FATAL  | jvm 1    | 2017/05/22 17:06:56 | com/mchange/v2/c3p0/DataSources
java.lang.NoClassDefFoundError: com/mchange/v2/c3p0/DataSources
        at org.hibernate.connection.C3P0ConnectionProvider.configure(C3P0ConnectionProvider.java:154)
        at org.hibernate.connection.ConnectionProviderFactory.newConnectionProvider(ConnectionProviderFactory.java:124)
        at org.hibernate.connection.ConnectionProviderFactory.newConnectionProvider(ConnectionProviderFactory.java:56)
        at org.hibernate.cfg.SettingsFactory.createConnectionProvider(SettingsFactory.java:414)
        at org.hibernate.cfg.SettingsFactory.buildSettings(SettingsFactory.java:62)
        at org.hibernate.cfg.Configuration.buildSettings(Configuration.java:2009)
        at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1292)
        at com.redhat.rhn.common.hibernate.ConnectionManager.createSessionFactory(ConnectionManager.java:205)
        at com.redhat.rhn.common.hibernate.ConnectionManager.initialize(ConnectionManager.java:134)
        at com.redhat.rhn.common.hibernate.HibernateFactory.createSessionFactory(HibernateFactory.java:107)
        at com.redhat.rhn.taskomatic.core.SchedulerKernel.startup(SchedulerKernel.java:139)
        at com.redhat.rhn.taskomatic.core.TaskomaticDaemon$1.run(TaskomaticDaemon.java:86)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.mchange.v2.c3p0.DataSources
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 13 more


Version-Release number of selected component (if applicable):
copy-jdk-configs-1.2-1.el7.noarch
java-1.7.0-openjdk-1.7.0.141-2.6.10.1.0.1.el7_3.x86_64
java-1.7.0-openjdk-devel-1.7.0.141-2.6.10.1.0.1.el7_3.x86_64
java-1.7.0-openjdk-headless-1.7.0.141-2.6.10.1.0.1.el7_3.x86_64
java-1.8.0-openjdk-1.8.0.131-2.b11.el7_3.x86_64
java-1.8.0-openjdk-headless-1.8.0.131-2.b11.el7_3.x86_64
javamail-1.4.6-8.el7.noarch
javapackages-tools-3.4.1-11.el7.noarch
javassist-3.16.1-10.el7.noarch
postgresql10-libs-10.0-beta1PGDG.rhel7.x86_64
postgresql-9.2.18-1.el7.x86_64
postgresql96-9.6.3-1PGDG.rhel7.x86_64
postgresql96-contrib-9.6.3-1PGDG.rhel7.x86_64
postgresql96-libs-9.6.3-1PGDG.rhel7.x86_64
postgresql-jdbc-42.1.1-1.rhel7.noarch
postgresql-libs-9.2.18-1.el7.x86_64
python-javapackages-3.4.1-11.el7.noarch
rhn-client-tools-2.6.8-1.el7.noarch
rhnlib-2.6.3-1.el7.noarch
rhn-org-httpd-ssl-key-pair-spacewalk-dmz-1.0-1.noarch
rhnpush-5.5.101-1.el7.noarch
spacewalk-admin-2.6.1-1.el7.noarch
spacewalk-backend-2.6.78-1.el7.noarch
spacewalk-backend-app-2.6.78-1.el7.noarch
spacewalk-backend-applet-2.6.78-1.el7.noarch
spacewalk-backend-config-files-2.6.78-1.el7.noarch
spacewalk-backend-config-files-common-2.6.78-1.el7.noarch
spacewalk-backend-config-files-tool-2.6.78-1.el7.noarch
spacewalk-backend-iss-2.6.78-1.el7.noarch
spacewalk-backend-iss-export-2.6.78-1.el7.noarch
spacewalk-backend-libs-2.6.78-1.el7.noarch
spacewalk-backend-package-push-server-2.6.78-1.el7.noarch
spacewalk-backend-server-2.6.78-1.el7.noarch
spacewalk-backend-sql-2.6.78-1.el7.noarch
spacewalk-backend-sql-postgresql-2.6.78-1.el7.noarch
spacewalk-backend-tools-2.6.78-1.el7.noarch
spacewalk-backend-usix-2.6.78-1.el7.noarch
spacewalk-backend-xml-export-libs-2.6.78-1.el7.noarch
spacewalk-backend-xmlrpc-2.6.78-1.el7.noarch
spacewalk-base-2.6.6-1.el7.noarch
spacewalk-base-minimal-2.6.6-1.el7.noarch
spacewalk-base-minimal-config-2.6.6-1.el7.noarch
spacewalk-branding-2.5.3-1.el7.noarch
spacewalk-certs-tools-2.5.3-1.el7.noarch
spacewalk-common-2.6.1-1.el7.noarch
spacewalk-config-2.6.5-1.el7.noarch
spacewalk-doc-indexes-2.6.2-1.el7.noarch
spacewalk-html-2.6.6-1.el7.noarch
spacewalk-java-2.6.49-1.el7.noarch
spacewalk-java-config-2.6.49-1.el7.noarch
spacewalk-java-lib-2.6.49-1.el7.noarch
spacewalk-java-postgresql-2.6.49-1.el7.noarch
spacewalk-jpp-workaround-2.3.5-1.el7.noarch
spacewalk-postgresql-2.6.1-1.el7.noarch
spacewalk-repo-2.6-0.el7.noarch
spacewalk-schema-2.6.17-1.el7.noarch
spacewalk-search-2.6.1-1.el7.noarch
spacewalk-selinux-2.3.2-1.el7.noarch
spacewalk-setup-2.6.2-1.el7.noarch
spacewalk-setup-jabberd-2.3.2-1.el7.noarch
spacewalk-taskomatic-2.6.49-1.el7.noarch
susestudio-java-client-0.1.4-4.el7.noarch
tzdata-java-2017b-1.el7.noarch


How reproducible:
Always.

Steps to Reproduce:
1. Install Centos 7, Oracle Linux 7, Scientific Linux 7, then enable additional repositories, last install spacewalk as given in https://github.com/spacewalkproject/spacewalk/wiki/HowToInstall
2. Configure spacewalk as given in https://github.com/spacewalkproject/spacewalk/wiki/HowToInstall
3. Start spacewalk, watch the daemons start, then stop. Have a look at various logs, find java exceptions.

Actual results:
Spacewalk throws exceptions at start

Expected results:
Spacewalk running and accessible

Additional info:
Tested with java-versions:
java-1.7.0-openjdk-1.7.0.141-2.6.10.1.0.1.el7_3.x86_64
java-1.8.0-openjdk-1.8.0.131-2.b11.el7_3.x86_64
jdk1.8.0_131-1.8.0_131-fcs.x86_64

same error in all cases!
Comment 1 Thomas Schweikle 2017-05-23 08:09:22 UTC 
Missing dependency??
Comment 2 Natarajan 2017-06-22 07:37:33 UTC 

This is caused by the updated c3p0 package (c3p0-0.9.2.1-5) from EPEL repository.

The lower version c3p0-0.9.1.2-2 will fix this issue.

[root@spacewalk01 rhn]# rpm -qa | grep  c3p0*
c3p0-0.9.2.1-5.jpp5.noarch

After spacewalk setup downgrade the c3p0 package 

yum downgrade c3p0

[root@spacewalk01 rhn]# rpm -qa | grep  c3p0*
c3p0-0.9.1.2-2.jpp5.noarch

 Now start the spacewalk service 

Test the service startup now

systemctl status taskomatic.service
systemctl start taskomatic.service
systemctl status taskomatic.service

Then restart Spacewalk service

/usr/sbin/spacewalk-service restart
Comment 3 Natarajan 2017-06-22 07:38:50 UTC 
This is caused by the updated c3p0 package (c3p0-0.9.2.1-5) from EPEL repository.

The lower version c3p0-0.9.1.2-2 will fix this issue.

[root@spacewalk01 rhn]# rpm -qa | grep  c3p0*
c3p0-0.9.2.1-5.jpp5.noarch

After spacewalk setup downgrade the c3p0 package 

yum downgrade c3p0

[root@spacewalk01 rhn]# rpm -qa | grep  c3p0*
c3p0-0.9.1.2-2.jpp5.noarch

Test the service startup now

systemctl status taskomatic.service
systemctl start taskomatic.service
systemctl status taskomatic.service

Then restart Spacewalk service

/usr/sbin/spacewalk-service restart
Comment 4 Michael Mráka 2017-09-27 07:04:11 UTC 
Already fixed in spacewalk master, most likely by
commit da7ff4efedf2f243aefd34921a405eff72eedc52
    no more special jar handling is needed
Comment 5 Eric Herget 2017-09-28 18:11:02 UTC 
This BZ closed some time during 2.5, 2.6 or 2.7.  Adding to 2.7 tracking bug.