Bug 1253335 - DistGitImporter stops work after some time due to "TOO MANY OPEN FILES"
Summary: DistGitImporter stops work after some time due to "TOO MANY OPEN FILES"
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Copr
Classification: Community
Component: backend
Version: unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: ---
Assignee: Valentin Gologuzov
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-08-13 13:50 UTC by Valentin Gologuzov
Modified: 2015-12-01 06:04 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-08-14 15:46:22 UTC
Embargoed:

Attachments (Terms of Use)

Description Valentin Gologuzov 2015-08-13 13:50:53 UTC 
Some code in dist-git-importer (or used libs) doesn't close file descriptors properly, so that each task adds two dangling fd.
I.e.:
[root@copr-dist-git-dev fd]# pwd
/proc/14175/fd
[root@copr-dist-git-dev fd]# for i in `seq 5 8`;do readlink $i; done
/tmp/tmpkuRMPr/autotools-git/.git/objects/pack/pack-a584fcd4a5f97f10559257f3c8a4f9517d5687ef.pack (deleted)
/tmp/tmpkuRMPr/autotools-git/.git/objects/pack/pack-a584fcd4a5f97f10559257f3c8a4f9517d5687ef.idx (deleted)
/tmp/tmpgAo3Ch/autotools-git/.git/objects/pack/pack-a584fcd4a5f97f10559257f3c8a4f9517d5687ef.pack (deleted)
/tmp/tmpgAo3Ch/autotools-git/.git/objects/pack/pack-a584fcd4a5f97f10559257f3c8a4f9517d5687ef.idx (deleted)

Investigate and solve. Temporary solution is to restart import process periodically.
Comment 1 Miroslav Suchý 2015-08-14 07:12:18 UTC 
Likely related to
https://github.com/gitpython-developers/GitPython/issues/304
Comment 2 Valentin Gologuzov 2015-08-14 15:46:22 UTC 
Released new version of copr-dist-git (0.6-1) into the production. Should be sufficient.
Note You need to log in before you can comment on or make changes to this bug.