Bug 1236708
Summary: | System registrations failing due to too many open files with Pulp | ||
---|---|---|---|
Product: | Red Hat Satellite | Reporter: | Chongrui Zhang <chozhang> |
Component: | Pulp | Assignee: | satellite6-bugs <satellite6-bugs> |
Status: | CLOSED DUPLICATE | QA Contact: | Katello QA List <katello-qa-list> |
Severity: | high | Docs Contact: | |
Priority: | unspecified | ||
Version: | 6.1.0 | CC: | akrzos, bbuckingham, cwelton, omaciel |
Target Milestone: | Unspecified | Keywords: | Triaged |
Target Release: | Unused | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2015-07-08 13:32:53 UTC | Type: | Bug |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: |
Description
Chongrui Zhang
2015-06-29 18:59:51 UTC
Since this issue was entered in Red Hat Bugzilla, the release flag has been set to ? to ensure that it is properly evaluated for this release. I ran through the tests with Chongrui and watched the number of file descriptors on the wsgi:pulp process. It grew 10 fds each successive subscription. For clarity on how we accomplished a large number of subscriptions we used the following: (We can scale this on 1-10 vms depending on the level of concurrency of subscriptions we intend on testing) 1. subscription-manager clean 2. subscription-manager register --org="Default_Organization" --activationkey=ak-1 3. Repeat above x 5000 At 1023 file descriptors the process actually seg faulted and left the following in /var/log/messages Jun 29 15:47:14 vtopt kernel: httpd[10828]: segfault at a8 ip 00007f6278afbcde sp 00007f625abfcc28 error 4 in libapr-1.so.0.3.9[7f6278ae4000+2b000] In the past we witnessed it stalled at 1023 and all subscriptions were blocked until that process was restarted. Blocked clients see the following: # subscription-manager register --org="Default_Organization" --activationkey=ak-1 There was an issue with the backend service pulp: Pulp message bus connection issue. *** This bug has been marked as a duplicate of bug 1236096 *** |