RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1951020 - Internal unindexed searches in syncrepl
Summary: Internal unindexed searches in syncrepl
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 8
Classification: Red Hat
Component: 389-ds-base
Version: 8.3
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: beta
: ---
Assignee: mreynolds
QA Contact: RHDS QE
Petr Hybl
URL:
Whiteboard: sync-to-jira
Depends On:
Blocks: 1983095 1993263 2005399
TreeView+ depends on / blocked
 
Reported: 2021-04-19 12:20 UTC by thierry bordaz
Modified: 2021-11-09 22:28 UTC (History)
4 users (show)

Fixed In Version: 389-ds-1.4-8050020210715192621.1a75f91c
Doc Type: Bug Fix
Doc Text:
.The database indexes created by plug-ins are now enabled Previously, when a server plug-in created its own database indexes, you had to enable those indexes manually. With this update, the indexes are enabled immediately after creation by default.
Clone Of:
: 1983095 1993263 2005399 (view as bug list)
Environment:
Last Closed: 2021-11-09 18:11:20 UTC
Type: Bug
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github 389ds 389-ds-base issues 4443 0 None open Internal unindexed searches in syncrepl 2021-04-19 12:22:22 UTC
Red Hat Product Errata RHBA-2021:4203 0 None None None 2021-11-09 18:12:06 UTC

Description thierry bordaz 2021-04-19 12:20:33 UTC 
Description of problem:
 I see plenty of complains about partial unindexed searches from syncrepl plugin even though there are indexes defined for the attributes specified in the filter

[15/Nov/2020:18:58:04.118737200 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=72)(targetuniqueid=cb0ce98a-279a11eb-b8b0c9d4-8de4b180))" etime=0.002251050 nentries=1  notes=U details="Partially Unindexed Filter"
[15/Nov/2020:18:58:04.136015700 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=73)(targetuniqueid=cb0ce98a-279a11eb-b8b0c9d4-8de4b180))" etime=0.002381400 nentries=1  notes=U details="Partially Unindexed Filter"
[15/Nov/2020:18:58:04.167502775 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=74)(targetuniqueid=cb0ce98a-279a11eb-b8b0c9d4-8de4b180))" etime=0.000606675 nentries=1  notes=U details="Partially Unindexed Filter"
[15/Nov/2020:18:58:04.187813900 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=74)(targetuniqueid=cb0ce98a-279a11eb-b8b0c9d4-8de4b180))" etime=0.000362425 nentries=1  notes=U details="Partially Unindexed Filter"
[15/Nov/2020:18:58:04.225106850 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=75)(targetuniqueid=cb0ce986-279a11eb-b8b0c9d4-8de4b180))" etime=0.001161925 nentries=1  notes=U details="Partially Unindexed Filter"
[15/Nov/2020:18:58:04.228923925 -0500] - ERR - log_result - Internal unindexed search: source (cn=server,cn=plugins,cn=config) search base="cn=changelog" filter="(&(changenumber>=75)(targetuniqueid=cb0ce986-279a11eb-b8b0c9d4-8de4b180))" etime=0.002395775 nentries=1  notes=U details="Partially Unindexed Filter"



Version-Release number of selected component (if applicable):
I think it exists since 1.4.3.1 (8.3)
9327a3328 Ticket 50727 - correct mistaken options in filter validation patch


How reproducible:
Should be systematic.
See upstream tickets https://github.com/389ds/389-ds-base/issues/4443


Steps to Reproduce:

Actual results:
Error in errors logs "Partially Unindexed Filter" and possibly (TBC) partial results 

Expected results:
Sync repl should not trigger those messages/partial results

Additional info:
Comment 6 sgouvern 2021-07-23 09:57:39 UTC 
============================================================ test session starts =============================================================
platform linux -- Python 3.6.8, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /usr/bin/python3.6
cachedir: .pytest_cache
metadata: {'Python': '3.6.8', 'Platform': 'Linux-4.18.0-321.el8.x86_64-x86_64-with-redhat-8.5-Ootpa', 'Packages': {'pytest': '6.2.4', 'py': '1.10.0', 'pluggy': '0.13.1'}, 'Plugins': {'metadata': '1.11.0', 'html': '3.1.1', 'libfaketime': '0.1.2', 'flaky': '3.7.0'}}
389-ds-base: 1.4.3.23-6.module+el8.5.0+11842+2f4233e8
nss: 3.53.1-17.el8_3
nspr: 4.25.0-2.el8_2
openldap: 2.4.46-17.el8
cyrus-sasl: 2.1.27-5.el8
FIPS: disabled
rootdir: /mnt/tests/rhds/tests/upstream/ds/dirsrvtests, configfile: pytest.ini
plugins: metadata-1.11.0, html-3.1.1, libfaketime-0.1.2, flaky-3.7.0
collected 1 item                                                                                                                             

dirsrvtests/tests/suites/retrocl/retrocl_indexing_test.py::test_indexing_is_online PASSED                                              [100%]

============================================================== warnings summary ==============================================================
tests/suites/retrocl/retrocl_indexing_test.py::test_indexing_is_online
tests/suites/retrocl/retrocl_indexing_test.py::test_indexing_is_online
  /mnt/tests/rhds/tests/upstream/ds/src/lib389/lib389/__init__.py:136: DeprecationWarning: Use of raw ldap function search_ext_s. This will be removed in a future release. Found in: /mnt/tests/rhds/tests/upstream/ds/src/lib389/lib389/_mapped_object.py:1267
    "Found in: %s:%s" % (name, frame.filename, frame.lineno)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================================================= 1 passed, 2 warnings in 15.85s =======================================================



Too 
Content Synchronization and Retro Changelog Plugin being enabled
running :
# ldapsearch -D "cn=directory manager" -WWW -LLL -b "dc=example,dc=com" -E sync=rp/"localhost.localdomain:389#cn=directory manager:dc=example,dc=com:(objectClass=*)#1"

didn't produce any ERR message in the errors log


marking as verified:tested
Comment 9 sgouvern 2021-07-23 16:33:14 UTC 
As per comment 6 marking as VERIFIED
Comment 13 Petr Hybl 2021-11-04 11:12:27 UTC 
Hi, can you please check if the doc text is okay?
Comment 14 mreynolds 2021-11-04 13:11:25 UTC 
(In reply to Petr Hybl from comment #13)
> Hi, can you please check if the doc text is okay?

Sorry I find it a bit confusing.  Perhaps this is better?

.The database indexes created by plugins are now enabled.
Previously when a server plugin created its own database indexes, those indexes were not enabled. Those indexes are now enabled immediately after creation.
Comment 16 errata-xmlrpc 2021-11-09 18:11:20 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (389-ds-base bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4203
Note You need to log in before you can comment on or make changes to this bug.