Description of problem: Internal Server Error on webui and machines connected to spacewalk fail to update from the channel. Version-Release number of selected component (if applicable): 1.9 nightly How reproducible: Constantly reproduceable Steps to Reproduce: 1. Upgrade 1.8 to 1.9 nightly 2. Run schema update 3. Restart spacewalk 4. Login and try and view a channel Actual results: Internal Server Error Expected results: View Channel or Sub channel info Additional info: Traceback attached. Exception: javax.servlet.ServletException: com.redhat.rhn.common.hibernate.HibernateRuntimeException: Executing query DistChannelMap.findByChannel with params {channel=com.redhat.rhn.domain.channel.Channel@7e8138a6[id=144,label=centos6-x86_64]} failed at org.apache.struts.action.RequestProcessor.processException(RequestProcessor.java:520) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:427) at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:228) at com.redhat.rhn.frontend.struts.RhnRequestProcessor.process(RhnRequestProcessor.java:99) at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913) at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:449) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.redhat.rhn.frontend.servlets.AuthFilter.doFilter(AuthFilter.java:93) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.opensymphony.sitemesh.webapp.SiteMeshFilter.obtainContent(SiteMeshFilter.java:129) at com.opensymphony.sitemesh.webapp.SiteMeshFilter.doFilter(SiteMeshFilter.java:77) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.redhat.rhn.frontend.servlets.LocalizedEnvironmentFilter.doFilter(LocalizedEnvironmentFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.redhat.rhn.frontend.servlets.EnvironmentFilter.doFilter(EnvironmentFilter.java:108) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.redhat.rhn.frontend.servlets.SessionFilter.doFilter(SessionFilter.java:55) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at com.redhat.rhn.frontend.servlets.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:97) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:769) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:698) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:891) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:679) Caused by: com.redhat.rhn.common.hibernate.HibernateRuntimeException: Executing query DistChannelMap.findByChannel with params {channel=com.redhat.rhn.domain.channel.Channel@7e8138a6[id=144,label=centos6-x86_64]} failed at com.redhat.rhn.common.hibernate.HibernateFactory.lookupObjectByNamedQuery(HibernateFactory.java:188) at com.redhat.rhn.common.hibernate.HibernateFactory.lookupObjectByNamedQuery(HibernateFactory.java:158) at com.redhat.rhn.domain.channel.ChannelFactory.lookupDistChannelMap(ChannelFactory.java:902) at com.redhat.rhn.domain.channel.Channel.isChannelRepodataRequired(Channel.java:833) at com.redhat.rhn.frontend.action.channel.ChannelDetailsAction.execute(ChannelDetailsAction.java:90) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:425) ... 40 more Caused by: org.hibernate.exception.SQLGrammarException: could not execute query at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:67) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) at org.hibernate.loader.Loader.doList(Loader.java:2223) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104) at org.hibernate.loader.Loader.list(Loader.java:2099) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378) at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338) at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172) at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121) at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79) at org.hibernate.impl.AbstractQueryImpl.uniqueResult(AbstractQueryImpl.java:811) at com.redhat.rhn.common.hibernate.HibernateFactory.lookupObjectByNamedQuery(HibernateFactory.java:182) ... 45 more Caused by: org.postgresql.util.PSQLException: ERROR: column distchanne0_.id does not exist Position: 8 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:271) at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:440) at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:186) at org.hibernate.loader.Loader.getResultSet(Loader.java:1787) at org.hibernate.loader.Loader.doQuery(Loader.java:674) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236) at org.hibernate.loader.Loader.doList(Loader.java:2220) ... 54 more
I am sorry, but upgrade from 1.8 to 1.9 nightly is not a valid use case. Just curious, could you paste the output of 'SELECT * FROM rhnDistChannelMap;' query run in psql?
No problem, sorry new to bugzilla spacewalk=> SELECT * FROM rhnDistChannelMap; ERROR: relation "rhndistchannelmap" does not exist LINE 1: SELECT * FROM rhnDistChannelMap;
spacewalk=> \l List of databases Name | Owner | Encoding | Collation | Ctype | Access privileges -------------+----------+----------+-------------+-------------+----------------------- postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | spaceschema | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | spacewalk | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/postgres : postgres=CTc/postgres : spaceman=CTc/postgres Sorry i don't know the databsse layouts enough to be very helpful on this one
Could you please paste output of select label, created, ( select evr from rhnpackageevr where evr_id = id ) as evr from rhnVersionInfo order by created ; when run in your psql? Also, you seem to have two databases that seem kinda related to spacewalk -- spaceschema and spacewalk. Which one is the correct one? Can you describe what were the exact steps that you did? Was is a fresh 1.8 installation or upgrade from older version? How did you upgrade to nightly? Did the 1.8 version work?
spaceschema=> select label, created, ( select evr from rhnpackageevr where evr_id = id ) as evr from rhnVersionInfo order by created ; ERROR: relation "rhnversioninfo" does not exist LINE 1: ...rom rhnpackageevr where evr_id = id ) as evr from rhnVersion... spacewalk=> select label, created, ( select evr from rhnpackageevr where evr_id = id ) as evr from rhnVersionInfo order by created ; ERROR: relation "rhnversioninfo" does not exist LINE 1: ...rom rhnpackageevr where evr_id = id ) as evr from rhnVersion... Looks like neither work.
db_name = spaceschema db_host = 127.0.0.1 db_port = 5432 Looks like spaceschema is the proper , from /etc/rhn/rhn.conf anyway.
(In reply to comment #5) > spaceschema=> select label, created, ( select evr from rhnpackageevr where > evr_id = id ) as evr from rhnVersionInfo order by created ; > ERROR: relation "rhnversioninfo" does not exist > LINE 1: ...rom rhnpackageevr where evr_id = id ) as evr from rhnVersion... What does \d print? Because it looks like your database is not populated at all. We will also need to know the exact steps and history of the installation.
No relations on either db. So they are indeed empty. Any logs that I can provide to prevent this from happening to others ?
(In reply to comment #8) > No relations on either db. So they are indeed empty. If you database is empty, it's really weird that you are able to start Spacewalk and log in to it. > Any logs that I can provide to prevent this from happening to others ? As I already wrote: we need to know how *exactly* you've installed the Spacewalk and how *exactly* you've upgraded it.
Rebuilt the db from scratch and lost all the channels and systems. Any logs I can provide that will show what commands where run against the db so we can prevent this in the future. Thanks.
well as for the login I use pam/ad. The basically I followed the centos 6.2 write up except it is on a redhat host. Upgrades and installs all came from rpm packages. One moment and I will find the link for the instal instructions.
http://computerglitch.net/bin/texts/CentOS6_Spacewalk_Server.php Pretty much the steps.
(In reply to comment #12) > http://computerglitch.net/bin/texts/CentOS6_Spacewalk_Server.php > > Pretty much the steps. This link describes installation of Spacewalk 1.5, not 1.8.
right the server started as a 1.5 then Upgraded to 1.7, then 1.8 then 1.9 nightly to solve some bugs I was running into.
This BZ closed some time during 2.5, 2.6 or 2.7. Adding to 2.7 tracking bug.