Bug 493810

Summary:	RFE: Slot/Job requirement diagnostics from Startd
Product:	Red Hat Enterprise MRG	Reporter:	Jan Sarenik <jsarenik>
Component:	condor	Assignee:	Matthew Farrellee <matt>
Status:	CLOSED NOTABUG	QA Contact:	Jan Sarenik <jsarenik>
Severity:	high	Docs Contact:
Priority:	medium
Version:	1.1	CC:	freznice, iboverma, matt, rrati
Target Milestone:	1.3	Keywords:	FutureFeature
Target Release:	---
Hardware:	All
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	Enhancement
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2010-06-04 12:01:13 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Jan Sarenik 2009-04-03 08:17:59 UTC

Since I was testing https://bugzilla.redhat.com/show_bug.cgi?id=472607
I kept adding the following lines to condor_config.local:

--------------------------------------------------
SLOT_TYPE_1 = CPUS=100%,DISK=100%,SWAP=100%
SLOT_TYPE_1_PARTITIONABLE = TRUE
NUM_SLOTS = 1
NUM_SLOTS_TYPE_1 = 1
--------------------------------------------------

These lines enable dynamic provisioning.

Now I wanted to test some low-latency job and despite all jobs
submitted via condor_submit worked well, I could not find out
why StartLog says "Slot requirements not satisfied." for any
AMQP submitted low-latency job. There was no helpful message
in log even with

ALL_DEBUG = D_FULLDEBUG D_JOB D_MACHINE D_COMMAND

After removing four lines mentioned above, everything started
to work seamlessly.

But even with those lines, I was able to make the AMQP-submitted
job run by adding RequestDisk and RequestMemory classads to
the job (as I was hinted by Matt).

Version affected (I am not sure all are used, but including
them for reference):
  condor-7.2.2-0.9.el5
  condor-low-latency-1.0-12.el5
  condor-job-hooks-1.0-5.el5
  condor-job-hooks-common-1.0-5.el5

I would expect it either to throw a meaningful message into
the log, or to run the job without hassle (not requiring
Request* ads). I think the latter implies the former one
anyway.

Comment 1 Matthew Farrellee 2009-04-03 13:06:56 UTC

Issue at hand is the interaction of fetched jobs and partitionable slots. Slots that can be partitioned require Request* attributes on incoming jobs, which is fine. The problem is that the code path used to actually partition slots is not hit for fetched jobs. This means a slot cannot be partitioned by a fetched job.

Comment 2 Matthew Farrellee 2009-05-01 15:41:49 UTC

This is probably best as an RFE for information as to why the job or slot are rejecting one another.

A workaround while debugging is to wrap the job's requirements or the slot's requirements in debug().

Comment 3 Jan Sarenik 2009-11-12 10:46:47 UTC

Target set to 1.3

Comment 4 Matthew Farrellee 2010-01-15 03:29:49 UTC

What would be useful?

Right now you can get a copy of the job and machine ads with D_JOB and D_MACHINE, and you'll get notification that their requirements were not met with either "Slot requirements not satisfied." or "Job requirements not satisfied."

Comment 5 Jan Sarenik 2010-01-21 13:26:48 UTC

Is there a use-case to use partitioned slots and low-latency
enabled at the same time? If not, I find no issues other than
that I tested in badly configured environment.

Otherwise I would like to know why normal condor_submit -ted
jobs went fine, while low-lat jobs ended with requirements
not satisfied.

According to this, I may think about some useful and easy
enhancement.

Comment 6 Matthew Farrellee 2010-01-22 04:38:15 UTC

There are such use-cases. The reason is condor_submit fills in a default RequestMemory and RequestDisk. The condor_submit tool is thick. In the low-latency case the writer of the message needs to replicate some of the knowledge embodied in condor_submit.

A condor_submit -> AMQP is desirable.

Comment 7 Jan Sarenik 2010-06-04 12:01:13 UTC

May be resurrected later if somebody asks for similar functionality,
but it was dead and I already do not work on testing Condor for months.
Closing as NOTABUG.