Bug 749023 - [RFE] reduce copious aviary logging
Summary: [RFE] reduce copious aviary logging
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise MRG
Classification: Red Hat
Component: condor-aviary
Version: 2.1
Hardware: All
OS: Linux
medium
low
Target Milestone: 2.1
: ---
Assignee: Pete MacKinnon
QA Contact: Lubos Trilety
URL:
Whiteboard:
Depends On:
Blocks: 743350
TreeView+ depends on / blocked
 
Reported: 2011-10-25 20:54 UTC by Timothy St. Clair
Modified: 2012-03-01 11:29 UTC (History)
5 users (show)

Fixed In Version: condor-7.6.5-0.3
Doc Type: Bug Fix
Doc Text:
Previous version of the Aviary web service interface generated many per-PID log files from the Axis2/C engine, causing unnecessary proliferation of files in the log directory. Now, Aviary logging setup uses a single log file each for the Aviary schedd plug-in and the query server that is continually appended to across process restarts and Aviary Axis2/C log file count is dramatically reduced.
Clone Of:
Environment:
Last Closed: 2012-01-23 17:29:40 UTC
Target Upstream Version:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2012:0045 0 normal SHIPPED_LIVE Red Hat Enterprise MRG Grid 2.1 bug fix and enhancement update 2012-01-23 22:22:58 UTC

Description Timothy St. Clair 2011-10-25 20:54:09 UTC
Description of problem:
When scanning the condor logs during testing there were a very large number of aviary logs, which could easily be amalgamated into a single log file.

Comment 1 Pete MacKinnon 2011-10-25 21:08:57 UTC
Well, "easily" is debatable since it is Axis2/C that manages the log file. It appears we would have to write our own logging extensions to achieve log appending, etc. There is still logging that occurs in the lower layers that we don't control.

Comment 2 Pete MacKinnon 2011-10-25 21:59:24 UTC
Modified code to collapse to single file logging from Aviary schedd plugin and Query Server respectively. There is still no "sync" point save timestamps between Condor and the Axis2/C logs generated.

Comment 3 Pete MacKinnon 2011-10-27 15:31:30 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.

Comment 5 Jeff Needle 2011-10-31 21:23:55 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,4 +1 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.-Consequence: Unnecessary proliferation of files in logging directory.
-Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
-Result: Aviary Axis2/C log file count dramatically reduced.

Comment 7 Lubos Trilety 2011-11-03 09:41:18 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1 +1,4 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.+Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Consequence: Unnecessary proliferation of files in logging directory.
+Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
+Result: Aviary Axis2/C log file count dramatically reduced.

Comment 8 Lubos Trilety 2011-11-04 13:58:47 UTC
Successfully reproduced on:
$CondorVersion: 7.6.5 Oct 21 2011 BuildID: RH-7.6.5-0.2.el5 $
$CondorPlatform: X86_64-RedHat_5.7 $

# ls aviary*
aviary_job.15632.axis2.log  aviary_query.15644.axis2.log
# condor_restart -schedd
Sent "Restart" command to local schedd
# ls aviary*
aviary_job.15632.axis2.log  aviary_job.15655.axis2.log  aviary_query.15644.axis2.log
# kill 15644
# ls aviary*
aviary_job.15632.axis2.log  aviary_job.15655.axis2.log  aviary_query.15644.axis2.log  aviary_query.15664.axis2.log

Comment 9 Lubos Trilety 2011-11-04 14:08:13 UTC
Tested on:
$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el5 $
$CondorPlatform: I686-RedHat_5.7 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el5 $
$CondorPlatform: X86_64-RedHat_5.7 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el6 $
$CondorPlatform: I686-RedHat_6.1 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el6 $
$CondorPlatform: X86_64-RedHat_6.1 $


# ls aviary*
aviary_job.log  aviary_query.log
# condor_restart -schedd
Sent "Restart" command to local schedd
# ls aviary*
aviary_job.log  aviary_query.log
# ps -eaf | grep aviary | grep -v grep
condor    2617  2605  0 Nov02 ?        00:00:00 aviary_query_server -f
# kill 2617
# ls aviary*
aviary_job.log  aviary_query.log

>>> VERIFIED

Comment 10 Tomas Capek 2011-11-16 13:47:56 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,4 +1 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Previous version of the Aviary web service interface generated many per-PID log files from the Axis2/C engine, causing unnecessary proliferation of files in the log directory. Now, Aviary logging setup uses a single log file each for the Aviary schedd plug-in and the query server that is continually appended to across process restarts and Aviary Axis2/C log file count is dramatically reduced.-Consequence: Unnecessary proliferation of files in logging directory.
-Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
-Result: Aviary Axis2/C log file count dramatically reduced.

Comment 11 errata-xmlrpc 2012-01-23 17:29:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2012-0045.html


Note You need to log in before you can comment on or make changes to this bug.