Bug 795435 - mongo error in log "key too large to index"
Summary: mongo error in log "key too large to index"
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: 1.1.0
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: ---
Assignee: James Slagle
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks: 805196 805616
TreeView+ depends on / blocked
 
Reported: 2012-02-20 14:27 UTC by James Slagle
Modified: 2012-05-25 14:14 UTC (History)
0 users

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 805196 805616 (view as bug list)
Environment:
Last Closed: 2012-05-25 14:14:02 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 795433 0 high CLOSED mongo logs growing too large 2021-02-22 00:41:40 UTC

Internal Links: 795433

Description James Slagle 2012-02-20 14:27:42 UTC 
I see several occurrences of this error in /var/log/mongodb/mongodb.log.

Thu Jun 30 16:32:19 [conn17]  pulp_unittest.packages Btree::insert: key too large to index, skipping pulp_unittest.packages.$description_-1 861 { : "Oauth2 was originally forked from Leah Culver and Andy Smith's oauth.p..." }

It's not specific to this one package, there are lots of references to packages.$description as being too large to index.  I also see occurrences of repos.$packagegroups, probably because that also has a lengthy description.

This has the potential to fill up the mongo log, making it very hard to see errors you might care about, as well as fill up disk space.

We should look at excluding these keys from indexing.
Comment 1 James Slagle 2012-03-19 20:58:11 UTC 
errata.description as well needs to be removed
Comment 2 James Slagle 2012-03-20 16:55:53 UTC 
cherry picked to pulp_v1 1129a660f14a2df404d01bdfb60eb1b779c7959e
Comment 3 Jeff Ortel 2012-04-12 22:59:06 UTC 
build: 0.282
Comment 4 Preethi Thomas 2012-04-18 15:12:54 UTC 
verified
[root@pulp-v1-1-server ~]# rpm -q pulp
pulp-1.1.2-1.fc16.noarch

checked /var/log/mongodb/mongodb.log
Comment 5 Preethi Thomas 2012-05-25 14:14:02 UTC 
Pulp v1.1 Release
Note You need to log in before you can comment on or make changes to this bug.