Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 749023

Summary: [RFE] reduce copious aviary logging
Product: Red Hat Enterprise MRG Reporter: Timothy St. Clair <tstclair>
Component: condor-aviaryAssignee: Pete MacKinnon <pmackinn>
Status: CLOSED ERRATA QA Contact: Lubos Trilety <ltrilety>
Severity: low Docs Contact:
Priority: medium    
Version: 2.1CC: jneedle, ltoscano, ltrilety, matt, tstclair
Target Milestone: 2.1   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: condor-7.6.5-0.3 Doc Type: Bug Fix
Doc Text:
Previous version of the Aviary web service interface generated many per-PID log files from the Axis2/C engine, causing unnecessary proliferation of files in the log directory. Now, Aviary logging setup uses a single log file each for the Aviary schedd plug-in and the query server that is continually appended to across process restarts and Aviary Axis2/C log file count is dramatically reduced.
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-01-23 17:29:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 743350    

Description Timothy St. Clair 2011-10-25 20:54:09 UTC
Description of problem:
When scanning the condor logs during testing there were a very large number of aviary logs, which could easily be amalgamated into a single log file.

Comment 1 Pete MacKinnon 2011-10-25 21:08:57 UTC
Well, "easily" is debatable since it is Axis2/C that manages the log file. It appears we would have to write our own logging extensions to achieve log appending, etc. There is still logging that occurs in the lower layers that we don't control.

Comment 2 Pete MacKinnon 2011-10-25 21:59:24 UTC
Modified code to collapse to single file logging from Aviary schedd plugin and Query Server respectively. There is still no "sync" point save timestamps between Condor and the Axis2/C logs generated.

Comment 3 Pete MacKinnon 2011-10-27 15:31:30 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.

Comment 5 Jeff Needle 2011-10-31 21:23:55 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,4 +1 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.-Consequence: Unnecessary proliferation of files in logging directory.
-Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
-Result: Aviary Axis2/C log file count dramatically reduced.

Comment 7 Lubos Trilety 2011-11-03 09:41:18 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1 +1,4 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
Consequence: Unnecessary proliferation of files in logging directory.
Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
Result: Aviary Axis2/C log file count dramatically reduced.+Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Consequence: Unnecessary proliferation of files in logging directory.
+Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
+Result: Aviary Axis2/C log file count dramatically reduced.

Comment 8 Lubos Trilety 2011-11-04 13:58:47 UTC
Successfully reproduced on:
$CondorVersion: 7.6.5 Oct 21 2011 BuildID: RH-7.6.5-0.2.el5 $
$CondorPlatform: X86_64-RedHat_5.7 $

# ls aviary*
aviary_job.15632.axis2.log  aviary_query.15644.axis2.log
# condor_restart -schedd
Sent "Restart" command to local schedd
# ls aviary*
aviary_job.15632.axis2.log  aviary_job.15655.axis2.log  aviary_query.15644.axis2.log
# kill 15644
# ls aviary*
aviary_job.15632.axis2.log  aviary_job.15655.axis2.log  aviary_query.15644.axis2.log  aviary_query.15664.axis2.log

Comment 9 Lubos Trilety 2011-11-04 14:08:13 UTC
Tested on:
$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el5 $
$CondorPlatform: I686-RedHat_5.7 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el5 $
$CondorPlatform: X86_64-RedHat_5.7 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el6 $
$CondorPlatform: I686-RedHat_6.1 $

$CondorVersion: 7.6.5 Oct 31 2011 BuildID: RH-7.6.5-0.5.el6 $
$CondorPlatform: X86_64-RedHat_6.1 $


# ls aviary*
aviary_job.log  aviary_query.log
# condor_restart -schedd
Sent "Restart" command to local schedd
# ls aviary*
aviary_job.log  aviary_query.log
# ps -eaf | grep aviary | grep -v grep
condor    2617  2605  0 Nov02 ?        00:00:00 aviary_query_server -f
# kill 2617
# ls aviary*
aviary_job.log  aviary_query.log

>>> VERIFIED

Comment 10 Tomas Capek 2011-11-16 13:47:56 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,4 +1 @@
-Cause: Previous version of Aviary generated many per-pid log files from the Axis2/C engine.
+Previous version of the Aviary web service interface generated many per-PID log files from the Axis2/C engine, causing unnecessary proliferation of files in the log directory. Now, Aviary logging setup uses a single log file each for the Aviary schedd plug-in and the query server that is continually appended to across process restarts and Aviary Axis2/C log file count is dramatically reduced.-Consequence: Unnecessary proliferation of files in logging directory.
-Change: Aviary logging setup now makes use of a single log file each for the Aviary schedd plugin and the query server that is continually appended to across process restarts.
-Result: Aviary Axis2/C log file count dramatically reduced.

Comment 11 errata-xmlrpc 2012-01-23 17:29:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2012-0045.html