Bug 1026956 - crash when removing entries from cache crash when removing entries from cache
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: 389-ds-base (Show other bugs)
Unspecified Unspecified
unspecified Severity high
: rc
: ---
Assigned To: Rich Megginson
Sankar Ramalingam
Depends On: 1026931
Blocks: 1061410
  Show dependency treegraph
Reported: 2013-11-05 12:46 EST by Nathan Kinder
Modified: 2014-10-14 03:52 EDT (History)
3 users (show)

See Also:
Fixed In Version: 389-ds-base-
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: 1026931
Last Closed: 2014-10-14 03:52:01 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)

  None (edit)
Description Nathan Kinder 2013-11-05 12:46:32 EST
+++ This bug was initially created as a clone of Bug #1026931 +++

This bug is created as a clone of upstream ticket:

1) setup up 2 way MMR
2) make sure the entry cache is full, so that search requests must evict old entries from the cache to make room for new entries
3) generate an ADD load against one of the masters
4) repeatedly search for (objectclass=nsTombstone) from the base suffix

--- Additional comment from Rich Megginson on 2013-11-05 12:44:26 EST ---

Steps to reproduce:

1) setup one instance of directory server with suffix dc=example,dc=com
2) Use ldclt like this to add a lot of entries:
    ldclt -h $HOST -p $PORT -D "$LDCLTDN" -w "$LDCLTPW" \
        -e add,person,incr,commoncounter,noloop \
        -r1 -R1000000 \
        -n8 \
        -f CN=XXXXXXX -b DC=EXAMPLE,DC=com \
        -q &
3) sleep 120 to allow some entries to search/mod/del
4) Use ldclt like this to do a lot of modifies:
    ldclt -h $HOST -p $PORT -D "$LDCLTDN" -w "$LDCLTPW" \
        -e incr,commoncounter,attreplace=sn:valueXXXXXXXXXX \
        -r1 -R1000000 \
        -n8 \
        -f CN=XXXXXXX -b DC=EXAMPLE,DC=com \
        -q &
5) sleep 30 to allow mods to progress
6) Use ldclt like this to do a lot of deletes:
    ldclt -h $HOST -p $PORT -D "$LDCLTDN" -w "$LDCLTPW" \
        -e delete,incr,commoncounter,noloop \
        -r1 -R1000000 \
        -n8 \
        -f CN=XXXXXXX -b DC=EXAMPLE,DC=com \
        -q &
7) use ldclt like this to do a lot of searches:
    ldclt -h $HOST -p $PORT -D "$LDCLTDN" -w "$LDCLTPW" \
        -e esearch,incr,commoncounter \
        -r1 -R1000000 \
        -n8 \
        -f CN=XXXXXXX -b DC=EXAMPLE,DC=com \
        -q &

You should see a crash within 10 minutes or so
Comment 2 Viktor Ashirov 2014-07-23 09:00:41 EDT
Followed steps mentioned in https://bugzilla.redhat.com/show_bug.cgi?id=1026956#c0

ldclt version 4.23
ldclt[24626]: Starting at Wed Jul 23 08:06:24 2014

ldclt[24626]: Average rate:   34.88/thr  (  27.90/sec), total:    279
ldclt[24626]: Average rate:   41.88/thr  (  33.50/sec), total:    335
ldclt[24626]: Average rate:   44.88/thr  (  35.90/sec), total:    359
ldclt[24626]: Average rate:   35.00/thr  (  28.00/sec), total:    280
ldclt[24626]: Average rate:   41.25/thr  (  33.00/sec), total:    330
ldclt[24626]: Average rate:   43.25/thr  (  34.60/sec), total:    346
ldclt[24626]: Average rate:   34.50/thr  (  27.60/sec), total:    276
ldclt[24626]: Average rate:   35.38/thr  (  28.30/sec), total:    283
ldclt[24626]: Average rate:   39.00/thr  (  31.20/sec), total:    312
ldclt[24626]: Average rate:   40.38/thr  (  32.30/sec), total:    323
ldclt[24626]: Average rate:   44.00/thr  (  35.20/sec), total:    352
ldclt[24626]: Average rate:   39.00/thr  (  31.20/sec), total:    312
ldclt version 4.23
ldclt[24648]: Starting at Wed Jul 23 08:08:24 2014

ldclt[24626]: Average rate:   15.50/thr  (  12.40/sec), total:    124
ldclt[24648]: Average rate:   15.00/thr  (  12.00/sec), total:    120
ldclt[24626]: Average rate:   20.88/thr  (  16.70/sec), total:    167
ldclt[24648]: Average rate:   21.12/thr  (  16.90/sec), total:    169
ldclt version 4.23
ldclt version 4.23
ldclt[24662]: Starting at Wed Jul 23 08:08:54 2014
ldclt[24661]: Starting at Wed Jul 23 08:08:54 2014

ldclt[24626]: Average rate:   21.38/thr  (  17.10/sec), total:    171
ldclt[24648]: Average rate:   21.00/thr  (  16.80/sec), total:    168
ldclt[24661]: Average rate: 30432.50/thr  (24346.00/sec), total: 243460
ldclt[24662]: Average rate:    7.25/thr  (   5.80/sec), total:     58
ldclt[24626]: Average rate:    6.62/thr  (   5.30/sec), total:     53
ldclt[24648]: Average rate:    7.75/thr  (   6.20/sec), total:     62
ldclt[24661]: Average rate: 27393.88/thr  (21915.10/sec), total: 219151


After several hours running ldclt DS didn't crash. Hence marking as verified.
Comment 3 errata-xmlrpc 2014-10-14 03:52:01 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.