Bug 507957
Summary: | dagman: schedd both accepts and starves more DAG jobs than MAX_JOBS_RUNNING | ||
---|---|---|---|
Product: | Red Hat Enterprise MRG | Reporter: | Pete MacKinnon <pmackinn> |
Component: | grid | Assignee: | Pete MacKinnon <pmackinn> |
Status: | CLOSED CURRENTRELEASE | QA Contact: | MRG Quality Engineering <mrgqe-bugs> |
Severity: | high | Docs Contact: | |
Priority: | medium | ||
Version: | Development | CC: | iboverma, matt |
Target Milestone: | 1.3 | ||
Target Release: | --- | ||
Hardware: | x86_64 | ||
OS: | Linux | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2010-07-22 17:17:16 UTC | Type: | --- |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: | |||
Bug Depends On: | 526480 | ||
Bug Blocks: |
Description
Pete MacKinnon
2009-06-24 20:21:28 UTC
Perhaps this is intended to be managed by combinations of? -maxidle <number> (Maximum number of idle nodes to allow) -maxjobs <number> (Maximum number of jobs ever submitted at once) Will experiment... Examining the submit code, -maxidle/-maxjobs provides no relief since they only count per dagman. Have to look at schedd to figure out if there is a way the submit client can get the "overall" picture at time of submission. New BZ created (526480) will promote workaround of capacity planning prior to large multi-dag deployments and setting an appropriately high MAX_JOBS_RUNNING (estimate # of concurrent dags X # of nodes for largest dag). Next level of analysis on this BZ will focus on why schedd appears to not be doing bookkeeping of ALL jobs (dagman+nodes). Will also try to solicit input/opinions from UW. Referenced upstream at http://condor-wiki.cs.wisc.edu/index.cgi/tktview?tn=642. Ultimate resolution in that ticket. Write a KB article that will be given to Lana for reference in next user Guide. Consult Mike Cressman or John Thomas for KB article tips. KB article http://kbase.redhat.com/faq/docs/DOC-33345 submitted to SME jthomas for tech review |