RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 601337 - debugging of daemons (e.g. NetworkManager) impossible due to missing syslog messages on s390x
Summary: debugging of daemons (e.g. NetworkManager) impossible due to missing syslog m...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: anaconda
Version: 6.0
Hardware: s390x
OS: Linux
low
medium
Target Milestone: rc
: ---
Assignee: David Cantrell
QA Contact: Release Test Team
URL:
Whiteboard:
Depends On:
Blocks: 647893
TreeView+ depends on / blocked
 
Reported: 2010-06-07 17:47 UTC by Steffen Maier
Modified: 2011-05-19 12:29 UTC (History)
7 users (show)

Fixed In Version: anaconda-13.21.88-1
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-05-19 12:29:44 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2011:0530 0 normal SHIPPED_LIVE anaconda bug fix and enhancement update 2011-05-18 17:44:52 UTC

Description Steffen Maier 2010-06-07 17:47:58 UTC
Description of problem:
Anaconda on s390x does not start a syslogd collecting and writing syslog messages from daemons such as NetworkManager (NM). The output of such daemons would only be visible with a syslogd running.
Most installations on s390x are network installations relying on NM to correctly manage the one network device used for retrieving stage2 (install.img) as well as all the meta data and RPM packages from the yum repository.

We have had at least the following bugs asking for /tmp/syslog on s390x
and it is hardly possible to debug some of those without syslog messages:
bug 541873
bug 578428
bug 597206
bug 591533

A patch backporting the most necessary part of upstream support for rsyslogd for s390x to RHEL6 was rejected
https://www.redhat.com/archives/anaconda-devel-list/2010-June/msg00003.html

An idea of breaking out the poor man's syslogd implementation of init.c was also rejected in bug 578428 comment 14. Otherwise, s390 could have a standalone minimum syslogd based on that code, just the way it uses a standalone shutdown based on code broken out of init.c/loader.c.

Specifying syslog= as boot option
http://fedoraproject.org/wiki/Anaconda/Options
or logger as kickstart command
http://fedoraproject.org/wiki/Anaconda/Kickstart#logging
is only to redirect syslog messages over the network to a remote syslogd but as far as I understood the code, this even requires a local rsyslogd to be running in the installation image:

http://fedoraproject.org/wiki/Anaconda/Logging#Remote_logging
"Anaconda supports remote logging handled through the rsyslog daemon running on the installed system. It can be configured to forward its logs through TCP to an arbitrary machine in network that is also running a syslog daemon. This is controlled with the syslog command line option."

Even when specifying "syslog=" as boot option to force loader to pass "--syslog" to anaconda, I do *not* see a syslog start up when anaconda starts from stage2 (which does contain syslogd implementations in its file system).
Even if it did startup at this point during installation, it would be too late for some debugging such as problems in retrieving stage2, since loader already starts NetworkManager much earlier.

Hence, no syslogd gets started and currently there seems no outlook on how to provide one on s390x.

Version-Release number of selected component (if applicable):
RHEL6.0-20100523.0

How reproducible:
Any arbitrary installation on s390x will do.

Actual results:
There is no /tmp/syslog or other place where syslog messages of e.g. NetworkManager appear, not even on any terminal.

Expected results:
/tmp/syslog exists and contains all syslog messages.

Comment 2 RHEL Program Management 2010-06-07 18:03:20 UTC
This request was evaluated by Red Hat Product Management for inclusion in a Red
Hat Enterprise Linux major release.  Product Management has requested further
review of this request by Red Hat Engineering, for potential inclusion in a Red
Hat Enterprise Linux Major release.  This request is not yet committed for
inclusion.

Comment 4 Ales Kozumplik 2011-01-07 13:56:34 UTC
David, I've pushed the rsyslogd parts:
6850919a1bf80dd8d1f6faacd939eafe6a2f3556
3c9de2230c304b48e5f6a658f2cb87482607decb

the daemon should be running in anaconda-13.21.87-1.

Comment 5 Steffen Maier 2011-01-10 12:58:29 UTC
(In reply to comment #4)
> David, I've pushed the rsyslogd parts:
> 6850919a1bf80dd8d1f6faacd939eafe6a2f3556
> 3c9de2230c304b48e5f6a658f2cb87482607decb
> 
> the daemon should be running in anaconda-13.21.87-1.

Unless, I've missed something, the linuxrc.s390 part of
https://www.redhat.com/archives/anaconda-devel-list/2010-June/msg00003.html
namely
https://www.redhat.com/archives/anaconda-devel-list/2010-June/msg00002.html
still seems missing, since currently only init.c starts rsyslogd but init.c is replaced by linuxrc.s390 on s390.

Comment 6 David Cantrell 2011-01-13 01:45:39 UTC
(In reply to comment #5)
> (In reply to comment #4)
> > David, I've pushed the rsyslogd parts:
> > 6850919a1bf80dd8d1f6faacd939eafe6a2f3556
> > 3c9de2230c304b48e5f6a658f2cb87482607decb
> > 
> > the daemon should be running in anaconda-13.21.87-1.
> 
> Unless, I've missed something, the linuxrc.s390 part of
> https://www.redhat.com/archives/anaconda-devel-list/2010-June/msg00003.html
> namely
> https://www.redhat.com/archives/anaconda-devel-list/2010-June/msg00002.html
> still seems missing, since currently only init.c starts rsyslogd but init.c is
> replaced by linuxrc.s390 on s390.

You didn't miss anything.  Ales and I discussed the work necessary for this bug and decided he would work in the main rsyslog changes and let me know when those were done, and I'd follow up with the s390 patch(es).  So you are responding to a comment he has used to indicate to me that he's done with his work and I can proceed with the s390 work.

Comment 8 Jan Stodola 2011-04-06 12:09:15 UTC
/tmp/syslog is created during the installation and contains messages from kernel, NetworkManager, dbus and so on. Messages are also displayed on terminal.

[anaconda root@rtt7 root]# ls -l /tmp
total 122892
-rw-r--r--. 1 root root       359 Apr  6 12:07 anaconda-yum.conf
-rw-r--r--. 1 root root      5221 Apr  6 12:07 anaconda.log
-rw-r--r--. 1 root root      1215 Apr  6 12:05 e40.conf
-rw-r--r--. 1 root root      3078 Apr  6 12:07 ifcfg.log
-rw-r--r--. 1 root root 125771776 Apr  6 12:06 install.img
-rw-------. 1 root root       235 Apr  6 12:06 libuser.216OsL
-rw-r--r--. 1 root root        16 Apr  6 12:05 modprobe.conf
drwx------. 2 root root         0 Apr  6 12:07 orbit-root
drwxr-xr-x. 5 root root         0 Apr  6 12:06 product
drwxr-xr-x. 2 root root         0 Apr  6 12:06 product-disk
-rw-r--r--. 1 root root      1120 Apr  6 12:07 program.log
-rw-r--r--. 1 root root         5 Apr  6 12:05 s390net
-rw-r--r--. 1 root root      2224 Apr  6 12:06 storage.log
-rw-r--r--. 1 root root     24051 Apr  6 12:06 syslog
drwxr-xr-x. 2 root root         0 Apr  6 12:06 updates
-rwxr-xr-x. 1 root root       576 Apr  6 12:07 vncserver.log


[anaconda root@rtt7 root]# cat /tmp/syslog
...
12:06:01,905 INFO NetworkManager: <info> (eth0): found s390 'qeth' subchannels [0.0.0a00,0.0.0a01,0.0.0a02]
12:06:01,905 INFO NetworkManager: <info> (eth0): carrier is ON
12:06:01,905 INFO NetworkManager: <info> (eth0): new Ethernet device (driver: 'qeth' ifindex: 2)
12:06:01,905 INFO NetworkManager: <info> (eth0): exported as /org/freedesktop/NetworkManager/Devices/0
12:06:01,905 INFO NetworkManager: <info> (eth0): now managed
12:06:01,905 INFO NetworkManager: <info> (eth0): device state change: 1 -> 2 (reason 41)
12:06:01,905 INFO NetworkManager: <info> (eth0): preparing device.
12:06:01,906 INFO NetworkManager: <info> Activation (eth0) starting connection 'System eth0'
...

Tested on build RHEL6.1-20110330.2 with anaconda-13.21.108-1.el6.

Moving to VERIFIED

Comment 9 errata-xmlrpc 2011-05-19 12:29:44 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2011-0530.html


Note You need to log in before you can comment on or make changes to this bug.