Bug 1013134

This bug is created as a clone of upstream ticket:
https://fedorahosted.org/389/ticket/419

https://bugzilla.redhat.com/show_bug.cgi?id=823882 (''Red Hat Directory Server'')

{{{
RFE Request

0. Proposed title of this feature request
Feature Request: better memory management in logconv.pl

2. What is the nature and description of the request?
Feature Request: better memory management in logconv.pl

3. Why does the customer need this? (List the business requirements here)
Since with Directory Server Red Hat offer an enterprise solution, a company
should be able to expect enterprise behaviour, in this case that is that the
product won't break from regular use. This is what's happening with the use of
logconv.pl: we use it to handle an undefined amount of logs, and we expect it
to do anyhing BUT break the system and cause unavailability. Whether it be an
error message (too many logs), a better handling of the logs (i.e. in chunks)
or a better memory management, all is acceptable. For a script like this to
crash a server is unacceptable in an enterprise environmemt.

4. How would the customer like to achieve this? (List the functional
requirements here)

Customer is expecting better memory Management in logconv.pl in below ways.
- refusing to start processing logs altogether when logconv.pl calculates the
logs are too big to be processed in memory
- processing logs in sizeable chunks and later adding these processed chunks
together to do a final report
- fine-tune the memory usage of logconv.pl
- finding temporary diskspace to flush parts of memory (of course with the
option of still one of the previous three when disk space is too low)

5. For each functional requirement listed in question 4, specify how Red Hat
and the customer can test to confirm the requirement is successfully
implemented.
Create a replica setup which generate 5 GB of daily logs & try to run
logconv.pl.

6. Is there already an existing RFE upstream or in Red Hat bugzilla?
No

7. How quickly does this need resolved? (desired target release)
No time-line

8. Does this request meet the RHEL Bug and Feature Inclusion Criteria (please
review)
Yes

9. List the affected packages
389-ds-base

10. Would the customer be able to assist in testing this functionality if
implemented?
Yes
}}}

USCBP would like this and all logconv.pl enhancements not currently in 6.4 to be available in 6.5