Bug 1861504

Summary: ds-replcheck crashes in offline mode
Product: Red Hat Enterprise Linux 8 Reporter: Dave <dsimes>
Component: 389-ds-baseAssignee: mreynolds
Status: CLOSED ERRATA QA Contact: RHDS QE <ds-qe-bugs>
Severity: high Docs Contact:
Priority: high    
Version: 8.4CC: ddas, msauton, pasik, sgouvern, spichugi, tbordaz, vashirov
Target Milestone: rcKeywords: ZStream
Target Release: 8.0Flags: pm-rhel: mirror+
Hardware: All   
OS: Linux   
Whiteboard: sync-to-jira
Fixed In Version: 389-ds-devel-1.4-8040020201105165416.866effaa Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1904353 (view as bug list) Environment:
Last Closed: 2021-05-18 15:45:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1904353    
Attachments:
Description Flags
Debugging logging added to ds-replcheck (version 1) none

Description Dave 2020-07-28 19:17:33 UTC
Description of problem:
ds-replcheck reporting issue? but also need to figure out how to fix the data (ongoing issues with compat plugin) and get the servers back into sync


Version-Release number of selected component (if applicable):
389-ds-base-1.3.9.1-13.el7_7.x86_64


How reproducible:
currently showing


Actual results:
see output/explanation below


Expected results:
no issue reported by ds-replcheck


Additional info:
running under IdM/IPA (as previously reported)

Comment 2 Dave 2020-07-28 19:20:57 UTC
ongoing issues with compat plugin, has messed up the data once again (happens every few weeks, we have dirsrv running in debug mode to attempt to capture), but ds-replcheck seems to not be accurately reporting what the raw ldap data shows, but we're also trying to figure out how to fix the data and get all the servers back into sync

Comment 14 mreynolds 2020-07-29 20:15:16 UTC
Created attachment 1702858 [details]
Debugging logging added to ds-replcheck (version 1)

This is the RHEL 7 version of ds-replcheck that has added debug output to the report.  It will generate a lot of output, and we need to see all of that output.

Comment 17 Dave 2020-07-30 17:50:00 UTC
(In reply to mreynolds from comment #14)
> Created attachment 1702858 [details]
> Debugging logging added to ds-replcheck (version 1)
> 
> This is the RHEL 7 version of ds-replcheck that has added debug output to
> the report.  It will generate a lot of output, and we need to see all of
> that output.

attempting..

Comment 20 Dave 2020-07-30 19:12:54 UTC
but not showing the dupes..

Comment 22 Dave 2020-07-30 19:40:52 UTC
attached debug output, tho again it looks like no dupes

Comment 24 mreynolds 2020-08-06 18:46:32 UTC
Upstream ticket:
https://pagure.io/389-ds-base/issue/51233

Comment 26 mreynolds 2020-08-06 19:15:21 UTC
I did check, the version of ds-replcheck is the same in 1.3.9.1-13 as what is in 1.3.10, so it's still a mystery about those duplicate warnings.  If they pop up again please use the debug build and hopefully capture some good data.

Comment 29 sgouvern 2020-11-13 15:28:49 UTC
With build 389-ds-base-1.4.3.16-1.module+el8.4.0+8740+d5ec8778.x86_64


[root@ci-vm-10-0-138-157 ds]# PYTHONPATH=src/lib389/ py.test -s -v dirsrvtests/tests/suites/ds_tools/replcheck_test.py 
re-exec with libfaketime dependencies
===================================================================== test session starts ======================================================================
platform linux -- Python 3.6.8, pytest-6.1.2, py-1.9.0, pluggy-0.13.1 -- /usr/bin/python3.6
cachedir: .pytest_cache
metadata: {'Python': '3.6.8', 'Platform': 'Linux-4.18.0-247.el8.x86_64-x86_64-with-redhat-8.4-Ootpa', 'Packages': {'pytest': '6.1.2', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'metadata': '1.10.0', 'html': '2.1.1', 'libfaketime': '0.1.2'}}
389-ds-base: 1.4.3.16-1.module+el8.4.0+8740+d5ec8778
nss: 3.53.1-11.el8_2
nspr: 4.25.0-2.el8_2
openldap: 2.4.46-16.el8
cyrus-sasl: 2.1.27-5.el8
FIPS: disabled
rootdir: /mnt/tests/rhds/tests/upstream/ds/dirsrvtests, configfile: pytest.ini
plugins: metadata-1.10.0, html-2.1.1, libfaketime-0.1.2
collected 9 items                             
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_check_ruv ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_missing_entries ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_tombstones ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_conflict_entries ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_inconsistencies ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_suffix_exists PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_check_missing_tombstones ldiffile: /tmp/export_master1.ldif
ldiffile: /tmp/export_master2.ldif
PASSED
dirsrvtests/tests/suites/ds_tools/replcheck_test.py::test_dsreplcheck_with_password_file PASSEDInstance slapd-master1 removed.
Instance slapd-master2 removed.


================================================================ 9 passed in 338.41s (0:05:38) =================================================================

Marking as Verified:tested

Comment 32 sgouvern 2020-11-16 15:29:41 UTC
verified:tested (see comment 29) with build https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=1383684 
-> marking as VERIFIED

Comment 36 errata-xmlrpc 2021-05-18 15:45:26 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (389-ds:1.4 bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:1835