Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 878485 Details for
Bug 1080491
Concurrency limits exceed their setting
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
NegotiatorLog
NegotiatorLog (text/plain), 1.56 MB, created by
Lubos Trilety
on 2014-03-25 14:30:17 UTC
(
hide
)
Description:
NegotiatorLog
Filename:
MIME Type:
Creator:
Lubos Trilety
Created:
2014-03-25 14:30:17 UTC
Size:
1.56 MB
patch
obsolete
>03/25/14 13:50:30 OpSysMajorVersion: 6 >03/25/14 13:50:30 OpSysShortName: RedHat >03/25/14 13:50:30 OpSysLongName: Red Hat Enterprise Linux Server release 6.5 (Santiago) >03/25/14 13:50:30 OpSysAndVer: RedHat6 >03/25/14 13:50:30 OpSysLegacy: LINUX >03/25/14 13:50:30 OpSysName: RedHat >03/25/14 13:50:30 OpSysVer: 605 >03/25/14 13:50:30 OpSys: LINUX >03/25/14 13:50:30 Using processor count: 1 processors, 1 CPUs, 0 HTs >03/25/14 13:50:30 Reading condor configuration from '/etc/condor/condor_config' >03/25/14 13:50:30 Setting maximum accepts per cycle 8. >03/25/14 13:50:30 ****************************************************** >03/25/14 13:50:30 ** condor_negotiator (CONDOR_NEGOTIATOR) STARTING UP >03/25/14 13:50:30 ** /usr/sbin/condor_negotiator >03/25/14 13:50:30 ** SubsystemInfo: name=NEGOTIATOR type=NEGOTIATOR(4) class=DAEMON(1) >03/25/14 13:50:30 ** Configuration: subsystem:NEGOTIATOR local:<NONE> class:DAEMON >03/25/14 13:50:30 ** $CondorVersion: 7.8.9 Mar 14 2014 BuildID: RH-7.8.9-0.8.el6 $ >03/25/14 13:50:30 ** $CondorPlatform: X86_64-RedHat_6.5 $ >03/25/14 13:50:30 ** PID = 22893 >03/25/14 13:50:30 ** Log last touched time unavailable (No such file or directory) >03/25/14 13:50:30 ****************************************************** >03/25/14 13:50:30 Using config source: /etc/condor/condor_config >03/25/14 13:50:30 Using local config sources: >03/25/14 13:50:30 /etc/condor/config.d/00personal_condor.config >03/25/14 13:50:30 /etc/condor/config.d/60condor-qmf.config >03/25/14 13:50:30 /etc/condor/config.d/61aviary.config >03/25/14 13:50:30 /etc/condor/config.d/99configd.config >03/25/14 13:50:30 /etc/condor/config.d/zzc_condor_initial_config.test >03/25/14 13:50:30 /etc/condor/config.d/zzz_condor_config.test >03/25/14 13:50:30 /var/lib/condor/wallaby_node.config >03/25/14 13:50:30 Not using shared port because USE_SHARED_PORT=false >03/25/14 13:50:30 DaemonCore: command socket at <IP:52195> >03/25/14 13:50:30 DaemonCore: private command socket at <IP:52195> >03/25/14 13:50:30 Setting maximum accepts per cycle 8. >03/25/14 13:50:30 Will use UDP to update collector <hostname> <IP:9618> >03/25/14 13:50:30 Not using shared port because USE_SHARED_PORT=false >03/25/14 13:50:30 PRIORITY_HALFLIFE=86400.000000 >03/25/14 13:50:30 NICE_USER_PRIO_FACTOR=10000000.000000 >03/25/14 13:50:30 REMOTE_PRIO_FACTOR=1.000000 >03/25/14 13:50:30 DEFAULT_PRIO_FACTOR=1.000000 >03/25/14 13:50:30 ACCOUNTANT_LOCAL_DOMAIN= >03/25/14 13:50:30 MAX_ACCOUNTANT_DATABASE_SIZE=1000000 >03/25/14 13:50:30 Accountant::Initialize - LogFileName=/var/lib/condor/spool/Accountantnew.log >03/25/14 13:50:30 Sanity check on number of resources per user >03/25/14 13:50:30 Accountant::SetPriorityFactor - CustomerName=<none>, PriorityFactor= 1.000 >03/25/14 13:50:30 (ACCOUNTANT) Updating priorities - AgingFactor= 0.000 , TimePassed=1395751830 >03/25/14 13:50:30 CustomerName=Customer.<none> , Old Priority=0.500 , New Priority=0.000 , ResourcesUsed=0 , WeightedResourcesUsed=0.000000 >03/25/14 13:50:30 RecentUsage= 0.000 (unweighted 0.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=0.000 (unweighted 0.000), BeginUsageTime=0 >03/25/14 13:50:30 NEGOTIATOR_SOCKET_CACHE_SIZE = 16 >03/25/14 13:50:30 PREEMPTION_REQUIREMENTS = ( (time() - EnteredCurrentState) > (1 * (60 * 60)) && RemoteUserPrio > TARGET.SubmitterUserPrio * 1.2 ) || (MY.NiceUser == True) >03/25/14 13:50:30 ACCOUNTANT_HOST = None (local) >03/25/14 13:50:30 NEGOTIATOR_INTERVAL = 20 sec >03/25/14 13:50:30 NEGOTIATOR_TIMEOUT = 30 sec >03/25/14 13:50:30 MAX_TIME_PER_SUBMITTER = 31536000 sec >03/25/14 13:50:30 MAX_TIME_PER_PIESPIN = 31536000 sec >03/25/14 13:50:30 PREEMPTION_RANK = (RemoteUserPrio * 1000000) - TARGET.ImageSize >03/25/14 13:50:30 NEGOTIATOR_PRE_JOB_RANK = RemoteOwner =?= UNDEFINED >03/25/14 13:50:30 NEGOTIATOR_POST_JOB_RANK = (RemoteOwner =?= UNDEFINED) * (KFlops - SlotID - 1.0e10*(Offline=?=True)) >03/25/14 13:50:30 Checking for PLUGINS config option >03/25/14 13:50:30 Plugin registration succeeded >03/25/14 13:50:30 Successfully loaded plugin: /usr/lib64/condor/plugins/MgmtNegotiatorPlugin-plugin.so >03/25/14 13:50:30 MgmtNegotiatorPlugin: Initializing... >03/25/14 13:50:30 Getting monitoring info for pid 22893 >03/25/14 13:50:30 DaemonCore: in SendAliveToParent() >03/25/14 13:50:30 Initialized the following authorization table: >03/25/14 13:50:30 Authorizations yet to be resolved: >03/25/14 13:50:30 allow READ: */* */<hostname> */IP >03/25/14 13:50:30 allow WRITE: */<hostname> */<hostname> */IP */IP */IP >03/25/14 13:50:30 allow NEGOTIATOR: */<hostname> */IP >03/25/14 13:50:30 allow ADMINISTRATOR: */<hostname> */<hostname> */IP */IP */IP */IP >03/25/14 13:50:30 allow OWNER: */<hostname> */<hostname> */<hostname> */IP */IP */IP */IP */IP >03/25/14 13:50:30 allow DAEMON: */<hostname> */<hostname> */IP */IP */IP >03/25/14 13:50:30 allow ADVERTISE_STARTD: */<hostname> */<hostname> */IP */IP */IP >03/25/14 13:50:30 allow ADVERTISE_SCHEDD: */<hostname> */<hostname> */IP */IP */IP >03/25/14 13:50:30 allow ADVERTISE_MASTER: */<hostname> */<hostname> */IP */IP */IP >03/25/14 13:50:30 Completed DC_CHILDALIVE to daemon at <IP:53996> >03/25/14 13:50:30 DaemonCore: Leaving SendAliveToParent() - success >03/25/14 13:50:30 ---------- Started Negotiation Cycle ---------- >03/25/14 13:50:30 Phase 1: Obtaining ads from collector ... >03/25/14 13:50:30 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:50:30 Trying to query collector <IP:9618> >03/25/14 13:50:30 Sorting 0 ads ... >03/25/14 13:50:30 Getting startd private ads ... >03/25/14 13:50:30 Trying to query collector <IP:9618> >03/25/14 13:50:30 Got ads: 0 public and 0 private >03/25/14 13:50:30 Public ads include 0 submitter, 0 startd >03/25/14 13:50:30 Phase 2: Performing accounting ... >03/25/14 13:50:30 Entering compute_significant_attrs() >03/25/14 13:50:30 (Accountant) Checking Matches >03/25/14 13:50:30 Previous Limits -- >03/25/14 13:50:30 Current Limits -- >03/25/14 13:50:30 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:50:30 Phase 4.1: Negotiating with schedds ... >03/25/14 13:50:30 numSlots = 0 >03/25/14 13:50:30 slotWeightTotal = 0.000000 >03/25/14 13:50:30 pieLeft = 0.000 >03/25/14 13:50:30 NormalFactor = 0.000000 >03/25/14 13:50:30 MaxPrioValue = 0.000000 >03/25/14 13:50:30 NumSubmitterAds = 0 >03/25/14 13:50:30 resources used scheddUsed= 0.000000 >03/25/14 13:50:30 negotiateWithGroup resources used scheddAds length 0 >03/25/14 13:50:30 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:50:30 enter Matchmaker::updateCollector >03/25/14 13:50:30 Warning: Could not find DaemonStartTime >03/25/14 13:50:30 Trying to update collector <IP:9618> >03/25/14 13:50:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 13:50:30 exit Matchmaker::UpdateCollector >03/25/14 13:50:31 Getting monitoring info for pid 22893 >03/25/14 13:50:32 Getting monitoring info for pid 22893 >03/25/14 13:50:33 Getting monitoring info for pid 22893 >03/25/14 13:50:34 Getting monitoring info for pid 22893 >03/25/14 13:50:35 Getting monitoring info for pid 22893 >03/25/14 13:50:36 Getting monitoring info for pid 22893 >03/25/14 13:50:37 Getting monitoring info for pid 22893 >03/25/14 13:50:38 Getting monitoring info for pid 22893 >03/25/14 13:50:39 Getting monitoring info for pid 22893 >03/25/14 13:50:40 Getting monitoring info for pid 22893 >03/25/14 13:50:41 Getting monitoring info for pid 22893 >03/25/14 13:50:42 Getting monitoring info for pid 22893 >03/25/14 13:50:43 Getting monitoring info for pid 22893 >03/25/14 13:50:44 Getting monitoring info for pid 22893 >03/25/14 13:50:45 Getting monitoring info for pid 22893 >03/25/14 13:50:46 Getting monitoring info for pid 22893 >03/25/14 13:50:47 Getting monitoring info for pid 22893 >03/25/14 13:50:48 Getting monitoring info for pid 22893 >03/25/14 13:50:49 Getting monitoring info for pid 22893 >03/25/14 13:50:50 ---------- Started Negotiation Cycle ---------- >03/25/14 13:50:50 Phase 1: Obtaining ads from collector ... >03/25/14 13:50:50 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:50:50 Trying to query collector <IP:9618> >03/25/14 13:50:50 Sorting 31 ads ... >03/25/14 13:50:50 Getting startd private ads ... >03/25/14 13:50:50 Trying to query collector <IP:9618> >03/25/14 13:50:50 Got ads: 31 public and 30 private >03/25/14 13:50:50 Public ads include 0 submitter, 30 startd >03/25/14 13:50:50 Phase 2: Performing accounting ... >03/25/14 13:50:50 Entering compute_significant_attrs() >03/25/14 13:50:50 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:50:50 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:50:50 CustomerName=Customer.<none> , Old Priority=0.500 , New Priority=0.500 , ResourcesUsed=0 , WeightedResourcesUsed=0.000000 >03/25/14 13:50:50 RecentUsage= 0.000 (unweighted 0.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=0.000 (unweighted 0.000), BeginUsageTime=0 >03/25/14 13:50:50 (Accountant) Checking Matches >03/25/14 13:50:50 Previous Limits -- >03/25/14 13:50:50 Current Limits -- >03/25/14 13:50:50 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:50:50 Phase 4.1: Negotiating with schedds ... >03/25/14 13:50:50 numSlots = 30 >03/25/14 13:50:50 slotWeightTotal = 30.000000 >03/25/14 13:50:50 pieLeft = 0.000 >03/25/14 13:50:50 NormalFactor = 0.000000 >03/25/14 13:50:50 MaxPrioValue = 0.000000 >03/25/14 13:50:50 NumSubmitterAds = 0 >03/25/14 13:50:50 resources used scheddUsed= 0.000000 >03/25/14 13:50:50 negotiateWithGroup resources used scheddAds length 0 >03/25/14 13:50:50 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:50:50 Getting monitoring info for pid 22893 >03/25/14 13:50:51 Getting monitoring info for pid 22893 >03/25/14 13:50:52 Getting monitoring info for pid 22893 >03/25/14 13:50:53 Getting monitoring info for pid 22893 >03/25/14 13:50:54 Getting monitoring info for pid 22893 >03/25/14 13:50:55 Getting monitoring info for pid 22893 >03/25/14 13:50:56 Getting monitoring info for pid 22893 >03/25/14 13:50:57 Getting monitoring info for pid 22893 >03/25/14 13:50:58 Getting monitoring info for pid 22893 >03/25/14 13:50:59 Getting monitoring info for pid 22893 >03/25/14 13:51:00 Getting monitoring info for pid 22893 >03/25/14 13:51:00 IPVERIFY: checking <hostname> against IP >03/25/14 13:51:00 IPVERIFY: matched IP to IP >03/25/14 13:51:00 IPVERIFY: ip found is 1 >03/25/14 13:51:00 IPVERIFY: checking lt-rhel6_64 against IP >03/25/14 13:51:00 IPVERIFY: matched IP to IP >03/25/14 13:51:00 IPVERIFY: ip found is 1 >03/25/14 13:51:00 Adding to resolved authorization table: unauthenticated@unmapped/IP: DAEMON >03/25/14 13:51:00 ---------- Started Negotiation Cycle ---------- >03/25/14 13:51:00 Phase 1: Obtaining ads from collector ... >03/25/14 13:51:00 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:51:00 Trying to query collector <IP:9618> >03/25/14 13:51:00 Sorting 32 ads ... >03/25/14 13:51:00 Getting startd private ads ... >03/25/14 13:51:00 Trying to query collector <IP:9618> >03/25/14 13:51:00 Got ads: 32 public and 30 private >03/25/14 13:51:00 Public ads include 1 submitter, 30 startd >03/25/14 13:51:00 Phase 2: Performing accounting ... >03/25/14 13:51:00 Entering compute_significant_attrs() >03/25/14 13:51:00 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:51:00 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=10 >03/25/14 13:51:00 CustomerName=Customer.<none> , Old Priority=0.500 , New Priority=0.500 , ResourcesUsed=0 , WeightedResourcesUsed=0.000000 >03/25/14 13:51:00 RecentUsage= 0.000 (unweighted 0.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=0.000 (unweighted 0.000), BeginUsageTime=0 >03/25/14 13:51:00 (Accountant) Checking Matches >03/25/14 13:51:00 Previous Limits -- >03/25/14 13:51:00 Current Limits -- >03/25/14 13:51:00 Accountant::SetPriorityFactor - CustomerName=test@<hostname>, PriorityFactor= 1.000 >03/25/14 13:51:00 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:51:00 Phase 4.1: Negotiating with schedds ... >03/25/14 13:51:00 numSlots = 30 >03/25/14 13:51:00 slotWeightTotal = 30.000000 >03/25/14 13:51:00 pieLeft = 30.000 >03/25/14 13:51:00 NormalFactor = 1.000000 >03/25/14 13:51:00 MaxPrioValue = 0.500000 >03/25/14 13:51:00 NumSubmitterAds = 1 >03/25/14 13:51:00 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:51:00 0 seconds so far >03/25/14 13:51:00 Calculating submitter limit with the following parameters >03/25/14 13:51:00 SubmitterPrio = 0.500000 >03/25/14 13:51:00 SubmitterPrioFactor = 1.000000 >03/25/14 13:51:00 submitterShare = 1.000000 >03/25/14 13:51:00 submitterAbsShare = 1.000000 >03/25/14 13:51:00 submitterLimit = 30.000000 >03/25/14 13:51:00 submitterUsage = 0.000000 >03/25/14 13:51:00 Socket to test@<hostname> (<IP:43885>) not in cache, creating one >03/25/14 13:51:00 SocketCache: Found unused slot 0 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00000: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 0.000000 pieLeft 30.000000 >03/25/14 13:51:00 Looking for Limit 'large.test' count, which does not exist >03/25/14 13:51:00 Concurrency Limit: large.test is 0.000000 >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:00 Start of sorting MatchList (len=30) >03/25/14 13:51:00 Finished sorting MatchList >03/25/14 13:51:00 Connecting to startd slot1@<hostname> at <IP:36601> >03/25/14 13:51:00 File descriptor limits: max 1024, safe 820 >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.0 test@<hostname> <IP:43885> preempting none <IP:36601> slot1@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=1.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 Looking for Limit 'large.test' count, which does not exist >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot1@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot1@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00001: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 1.000000 pieLeft 29.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 1.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 28, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot2@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.1 test@<hostname> <IP:43885> preempting none <IP:36601> slot2@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=2.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot2@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot2@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00002: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 2.000000 pieLeft 28.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 2.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 27, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot3@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.2 test@<hostname> <IP:43885> preempting none <IP:36601> slot3@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=3.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot3@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot3@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00003: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 3.000000 pieLeft 27.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 3.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 26, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot4@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.3 test@<hostname> <IP:43885> preempting none <IP:36601> slot4@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=4.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot4@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot4@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00004: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 4.000000 pieLeft 26.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 4.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 25, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot5@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.4 test@<hostname> <IP:43885> preempting none <IP:36601> slot5@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=5.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot5@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot5@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00005: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 5.000000 pieLeft 25.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 5.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 24, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot8@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.5 test@<hostname> <IP:43885> preempting none <IP:36601> slot8@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=6.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot8@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot8@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:00 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:00 Request 00001.00006: >03/25/14 13:51:00 matchmakingAlgorithm: limit 30.000000 used 6.000000 pieLeft 24.000000 >03/25/14 13:51:00 Concurrency Limit: large.test is 6.000000 >03/25/14 13:51:00 Attempting to use cached MatchList: Succeeded. (MatchList length: 23, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:00 Connecting to startd slot9@<hostname> at <IP:36601> >03/25/14 13:51:00 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:00 Matched 1.6 test@<hostname> <IP:43885> preempting none <IP:36601> slot9@<hostname> >03/25/14 13:51:00 Notifying the accountant >03/25/14 13:51:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:51:00 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:00 GroupWeightedResourcesUsed=7.000000 SlotWeight=1.000000 >03/25/14 13:51:00 IncrementLimit(large.test) >03/25/14 13:51:00 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot9@<hostname>@<IP:36601> >03/25/14 13:51:00 Successfully matched with slot9@<hostname> >03/25/14 13:51:00 Match completed, match cost= 1 >03/25/14 13:51:00 Sending SEND_JOB_INFO/eom >03/25/14 13:51:00 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00007: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 7.000000 pieLeft 23.000000 >03/25/14 13:51:01 Concurrency Limit: large.test is 7.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 22, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot10@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.7 test@<hostname> <IP:43885> preempting none <IP:36601> slot10@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=8.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(large.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot10@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot10@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00008: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 8.000000 pieLeft 22.000000 >03/25/14 13:51:01 Concurrency Limit: large.test is 8.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 21, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot11@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.8 test@<hostname> <IP:43885> preempting none <IP:36601> slot11@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=9.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(large.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot11@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot11@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00009: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 9.000000 pieLeft 21.000000 >03/25/14 13:51:01 Concurrency Limit: large.test is 9.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 20, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot12@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.9 test@<hostname> <IP:43885> preempting none <IP:36601> slot12@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=10.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(large.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot12@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot12@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00010: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 10.000000 pieLeft 20.000000 >03/25/14 13:51:01 Concurrency Limit: large.test is 10.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 19, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot13@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.10 test@<hostname> <IP:43885> preempting none <IP:36601> slot13@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=11.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(large.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot13@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot13@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00011: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 11.000000 pieLeft 19.000000 >03/25/14 13:51:01 Concurrency Limit: large.test is 11.000000 >03/25/14 13:51:01 Concurrency Limit large.test is 11.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:51:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00020: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 11.000000 pieLeft 19.000000 >03/25/14 13:51:01 Looking for Limit 'medium.test' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: medium.test is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=19) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot16@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.20 test@<hostname> <IP:43885> preempting none <IP:36601> slot16@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=12.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.test) >03/25/14 13:51:01 Looking for Limit 'medium.test' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot16@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot16@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00021: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 12.000000 pieLeft 18.000000 >03/25/14 13:51:01 Concurrency Limit: medium.test is 1.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 17, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot17@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.21 test@<hostname> <IP:43885> preempting none <IP:36601> slot17@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=13.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot17@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot17@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00022: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 13.000000 pieLeft 17.000000 >03/25/14 13:51:01 Concurrency Limit: medium.test is 2.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 16, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot18@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.22 test@<hostname> <IP:43885> preempting none <IP:36601> slot18@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=14.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot18@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot18@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00023: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 14.000000 pieLeft 16.000000 >03/25/14 13:51:01 Concurrency Limit: medium.test is 3.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 15, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot19@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.23 test@<hostname> <IP:43885> preempting none <IP:36601> slot19@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=15.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot19@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot19@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00024: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 15.000000 pieLeft 15.000000 >03/25/14 13:51:01 Concurrency Limit: medium.test is 4.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 14, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot20@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.24 test@<hostname> <IP:43885> preempting none <IP:36601> slot20@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=16.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot20@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot20@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00025: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 16.000000 pieLeft 14.000000 >03/25/14 13:51:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:51:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00040: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 16.000000 pieLeft 14.000000 >03/25/14 13:51:01 Looking for Limit 'small.test' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: small.test is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=14) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot21@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.40 test@<hostname> <IP:43885> preempting none <IP:36601> slot21@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=17.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(small.test) >03/25/14 13:51:01 Looking for Limit 'small.test' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot21@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot21@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00041: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 17.000000 pieLeft 13.000000 >03/25/14 13:51:01 Concurrency Limit: small.test is 1.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 12, Autocluster: 1, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot24@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.41 test@<hostname> <IP:43885> preempting none <IP:36601> slot24@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=18.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(small.test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot24@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot24@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00042: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 18.000000 pieLeft 12.000000 >03/25/14 13:51:01 Concurrency Limit: small.test is 2.000000 >03/25/14 13:51:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:51:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00060: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 18.000000 pieLeft 12.000000 >03/25/14 13:51:01 Looking for Limit 'test' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: test is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=12) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot25@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.60 test@<hostname> <IP:43885> preempting none <IP:36601> slot25@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=19.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(test) >03/25/14 13:51:01 Looking for Limit 'test' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot25@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot25@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00061: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 19.000000 pieLeft 11.000000 >03/25/14 13:51:01 Concurrency Limit: test is 1.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 10, Autocluster: 2, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot26@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.61 test@<hostname> <IP:43885> preempting none <IP:36601> slot26@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=20.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot26@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot26@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00062: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 20.000000 pieLeft 10.000000 >03/25/14 13:51:01 Concurrency Limit: test is 2.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 9, Autocluster: 2, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot27@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.62 test@<hostname> <IP:43885> preempting none <IP:36601> slot27@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=21.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(test) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot27@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot27@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00063: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 21.000000 pieLeft 9.000000 >03/25/14 13:51:01 Concurrency Limit: test is 3.000000 >03/25/14 13:51:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:51:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00080: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 21.000000 pieLeft 9.000000 >03/25/14 13:51:01 Looking for Limit 'undef.test' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: undef.test is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=9) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot28@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.80 test@<hostname> <IP:43885> preempting none <IP:36601> slot28@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=22.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(undef.test) >03/25/14 13:51:01 Looking for Limit 'undef.test' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot28@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot28@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00081: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 22.000000 pieLeft 8.000000 >03/25/14 13:51:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:51:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00100: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 22.000000 pieLeft 8.000000 >03/25/14 13:51:01 Looking for Limit 'undef' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: undef is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=8) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot29@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.100 test@<hostname> <IP:43885> preempting none <IP:36601> slot29@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=23.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(undef) >03/25/14 13:51:01 Looking for Limit 'undef' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot29@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot29@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00101: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 23.000000 pieLeft 7.000000 >03/25/14 13:51:01 Concurrency Limit: undef is 1.000000 >03/25/14 13:51:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00120: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 23.000000 pieLeft 7.000000 >03/25/14 13:51:01 Looking for Limit 'medium.undef' count, which does not exist >03/25/14 13:51:01 Concurrency Limit: medium.undef is 0.000000 >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Failed to evaluate NEGOTIATOR_POST_JOB_RANK expression to a float. >03/25/14 13:51:01 Start of sorting MatchList (len=7) >03/25/14 13:51:01 Finished sorting MatchList >03/25/14 13:51:01 Connecting to startd slot30@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.120 test@<hostname> <IP:43885> preempting none <IP:36601> slot30@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=24.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.undef) >03/25/14 13:51:01 Looking for Limit 'medium.undef' count, which does not exist >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot30@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot30@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00121: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 24.000000 pieLeft 6.000000 >03/25/14 13:51:01 Concurrency Limit: medium.undef is 1.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 5, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot22@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.121 test@<hostname> <IP:43885> preempting none <IP:36601> slot22@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=25.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.undef) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot22@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot22@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00122: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 25.000000 pieLeft 5.000000 >03/25/14 13:51:01 Concurrency Limit: medium.undef is 2.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 4, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot23@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.122 test@<hostname> <IP:43885> preempting none <IP:36601> slot23@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=26.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.undef) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot23@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot23@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00123: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 26.000000 pieLeft 4.000000 >03/25/14 13:51:01 Concurrency Limit: medium.undef is 3.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 3, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot14@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.123 test@<hostname> <IP:43885> preempting none <IP:36601> slot14@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=27.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.undef) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot14@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot14@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00124: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 27.000000 pieLeft 3.000000 >03/25/14 13:51:01 Concurrency Limit: medium.undef is 4.000000 >03/25/14 13:51:01 Attempting to use cached MatchList: Succeeded. (MatchList length: 2, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:01 Connecting to startd slot15@<hostname> at <IP:36601> >03/25/14 13:51:01 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:01 Matched 1.124 test@<hostname> <IP:43885> preempting none <IP:36601> slot15@<hostname> >03/25/14 13:51:01 Notifying the accountant >03/25/14 13:51:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:51:01 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:01 GroupWeightedResourcesUsed=28.000000 SlotWeight=1.000000 >03/25/14 13:51:01 IncrementLimit(medium.undef) >03/25/14 13:51:01 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot15@<hostname>@<IP:36601> >03/25/14 13:51:01 Successfully matched with slot15@<hostname> >03/25/14 13:51:01 Match completed, match cost= 1 >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:01 Request 00001.00125: >03/25/14 13:51:01 matchmakingAlgorithm: limit 30.000000 used 28.000000 pieLeft 2.000000 >03/25/14 13:51:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:51:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:51:01 Sending SEND_JOB_INFO/eom >03/25/14 13:51:01 Getting reply from schedd ... >03/25/14 13:51:01 Got NO_MORE_JOBS; done negotiating >03/25/14 13:51:01 Submitter test@<hostname> got all it wants; removing it. >03/25/14 13:51:01 resources used by test@<hostname> are 28.000000 >03/25/14 13:51:01 resources used scheddUsed= 28.000000 >03/25/14 13:51:01 negotiateWithGroup resources used scheddAds length 0 >03/25/14 13:51:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:51:01 Getting monitoring info for pid 22893 >03/25/14 13:51:02 Getting monitoring info for pid 22893 >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot2@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#2#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot3@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#3#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot4@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#4#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot5@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#5#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot8@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#8#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot9@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#9#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot10@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#10#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot11@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#11#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot12@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#12#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot13@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#13#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot16@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#16#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot17@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#17#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot18@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#18#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot19@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#19#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot20@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#20#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot21@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#21#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot24@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#24#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot25@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#25#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot26@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#26#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot27@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#27#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot28@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#28#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot29@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#29#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot30@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#30#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot22@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#22#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot23@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#23#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot14@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#14#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot15@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#15#..." ) >03/25/14 13:51:02 Sending MATCH_INFO/claim id to slot1@<hostname> >03/25/14 13:51:02 (Claim ID is "<IP:36601>#1395751830#1#..." ) >03/25/14 13:51:03 Getting monitoring info for pid 22893 >03/25/14 13:51:04 Getting monitoring info for pid 22893 >03/25/14 13:51:05 Getting monitoring info for pid 22893 >03/25/14 13:51:06 Getting monitoring info for pid 22893 >03/25/14 13:51:07 Getting monitoring info for pid 22893 >03/25/14 13:51:08 Getting monitoring info for pid 22893 >03/25/14 13:51:09 Getting monitoring info for pid 22893 >03/25/14 13:51:10 Getting monitoring info for pid 22893 >03/25/14 13:51:11 Getting monitoring info for pid 22893 >03/25/14 13:51:12 Getting monitoring info for pid 22893 >03/25/14 13:51:13 Getting monitoring info for pid 22893 >03/25/14 13:51:14 Getting monitoring info for pid 22893 >03/25/14 13:51:15 Getting monitoring info for pid 22893 >03/25/14 13:51:16 Getting monitoring info for pid 22893 >03/25/14 13:51:17 Getting monitoring info for pid 22893 >03/25/14 13:51:18 Getting monitoring info for pid 22893 >03/25/14 13:51:19 Getting monitoring info for pid 22893 >03/25/14 13:51:20 Getting monitoring info for pid 22893 >03/25/14 13:51:21 ---------- Started Negotiation Cycle ---------- >03/25/14 13:51:21 Phase 1: Obtaining ads from collector ... >03/25/14 13:51:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:51:21 Trying to query collector <IP:9618> >03/25/14 13:51:21 Sorting 32 ads ... >03/25/14 13:51:21 Getting startd private ads ... >03/25/14 13:51:21 Trying to query collector <IP:9618> >03/25/14 13:51:22 Got ads: 32 public and 30 private >03/25/14 13:51:22 Public ads include 1 submitter, 30 startd >03/25/14 13:51:22 Phase 2: Performing accounting ... >03/25/14 13:51:22 Entering compute_significant_attrs() >03/25/14 13:51:22 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:51:22 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=22 >03/25/14 13:51:22 CustomerName=Customer.<none> , Old Priority=0.500 , New Priority=0.505 , ResourcesUsed=28 , WeightedResourcesUsed=28.000000 >03/25/14 13:51:22 RecentUsage= 27.045 (unweighted 27.045), UnchargedTime= -21.000 (unweighted -21), AccumulatedUsage=595.000 (unweighted 595.000), BeginUsageTime=0 >03/25/14 13:51:22 CustomerName=Customer.test@<hostname> , Old Priority=0.500 , New Priority=0.505 , ResourcesUsed=28 , WeightedResourcesUsed=28.000000 >03/25/14 13:51:22 RecentUsage= 27.045 (unweighted 27.045), UnchargedTime= -21.000 (unweighted -21), AccumulatedUsage=595.000 (unweighted 595.000), BeginUsageTime=0 >03/25/14 13:51:22 (Accountant) Checking Matches >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot5@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =27 GroupWeightedResourcesUsed= 27.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot5@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot25@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =26 GroupWeightedResourcesUsed= 26.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot25@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot17@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =25 GroupWeightedResourcesUsed= 25.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot17@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot4@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =24 GroupWeightedResourcesUsed= 24.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot4@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot23@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =23 GroupWeightedResourcesUsed= 23.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot23@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot15@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =22 GroupWeightedResourcesUsed= 22.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot15@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot30@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =21 GroupWeightedResourcesUsed= 21.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot30@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot22@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =20 GroupWeightedResourcesUsed= 20.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot22@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot14@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =19 GroupWeightedResourcesUsed= 19.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot14@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot21@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =18 GroupWeightedResourcesUsed= 18.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot21@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot13@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =17 GroupWeightedResourcesUsed= 17.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot13@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot20@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =16 GroupWeightedResourcesUsed= 16.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot20@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot29@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =15 GroupWeightedResourcesUsed= 15.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot29@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot12@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =14 GroupWeightedResourcesUsed= 14.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot12@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot28@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =13 GroupWeightedResourcesUsed= 13.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot28@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot11@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =12 GroupWeightedResourcesUsed= 12.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot11@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot27@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =11 GroupWeightedResourcesUsed= 11.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot27@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot10@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =10 GroupWeightedResourcesUsed= 10.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot10@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot19@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =9 GroupWeightedResourcesUsed= 9.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot19@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot26@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =8 GroupWeightedResourcesUsed= 8.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot26@<hostname>@<IP:36601> >03/25/14 13:51:22 State was Unclaimed - not claimed or matched >03/25/14 13:51:22 Resource slot18@<hostname>@<IP:36601> was not claimed by test@<hostname> - removing match >03/25/14 13:51:22 Accountant::RemoveMatch - ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupResourcesUsed =7 GroupWeightedResourcesUsed= 7.000000 SlotWeight=1.000000 >03/25/14 13:51:22 (ACCOUNTANT) Removed match between customer test@<hostname> and resource slot18@<hostname>@<IP:36601> >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:51:22 Match already existed! >03/25/14 13:51:22 Previous Limits -- >03/25/14 13:51:22 Limit: test = 3.000000 >03/25/14 13:51:22 Limit: small.test = 2.000000 >03/25/14 13:51:22 Limit: medium.test = 5.000000 >03/25/14 13:51:22 Limit: undef.test = 1.000000 >03/25/14 13:51:22 Limit: undef = 1.000000 >03/25/14 13:51:22 Limit: large.test = 11.000000 >03/25/14 13:51:22 Limit: medium.undef = 5.000000 >03/25/14 13:51:22 IncrementLimit(small.test) >03/25/14 13:51:22 IncrementLimit(medium.test) >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 Current Limits -- >03/25/14 13:51:22 Limit: test = 0.000000 >03/25/14 13:51:22 Limit: small.test = 1.000000 >03/25/14 13:51:22 Limit: medium.test = 1.000000 >03/25/14 13:51:22 Limit: undef.test = 0.000000 >03/25/14 13:51:22 Limit: undef = 0.000000 >03/25/14 13:51:22 Limit: large.test = 5.000000 >03/25/14 13:51:22 Limit: medium.undef = 0.000000 >03/25/14 13:51:22 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:51:22 Phase 4.1: Negotiating with schedds ... >03/25/14 13:51:22 numSlots = 30 >03/25/14 13:51:22 slotWeightTotal = 30.000000 >03/25/14 13:51:22 pieLeft = 23.000 >03/25/14 13:51:22 NormalFactor = 1.000000 >03/25/14 13:51:22 MaxPrioValue = 0.504685 >03/25/14 13:51:22 NumSubmitterAds = 1 >03/25/14 13:51:22 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:51:22 0 seconds so far >03/25/14 13:51:22 Calculating submitter limit with the following parameters >03/25/14 13:51:22 SubmitterPrio = 0.504685 >03/25/14 13:51:22 SubmitterPrioFactor = 1.000000 >03/25/14 13:51:22 submitterShare = 1.000000 >03/25/14 13:51:22 submitterAbsShare = 1.000000 >03/25/14 13:51:22 submitterLimit = 23.000000 >03/25/14 13:51:22 submitterUsage = 7.000000 >03/25/14 13:51:22 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00011: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 0.000000 pieLeft 23.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 5.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=23) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot4@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot4@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#4#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.11 test@<hostname> <IP:43885> preempting none <IP:36601> slot4@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=8.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot4@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot4@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00012: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 1.000000 pieLeft 22.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 6.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 21, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot5@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot5@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#5#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.12 test@<hostname> <IP:43885> preempting none <IP:36601> slot5@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=9.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot5@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot5@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00013: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 2.000000 pieLeft 21.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 7.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 20, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot6@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot6@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#6#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.13 test@<hostname> <IP:43885> preempting none <IP:36601> slot6@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=10.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot6@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot6@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00014: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 3.000000 pieLeft 20.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 8.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 19, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot7@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot7@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#7#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.14 test@<hostname> <IP:43885> preempting none <IP:36601> slot7@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=11.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot7@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot7@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00015: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 4.000000 pieLeft 19.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 9.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 18, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot10@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot10@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#10#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.15 test@<hostname> <IP:43885> preempting none <IP:36601> slot10@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=12.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot10@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot10@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00016: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 5.000000 pieLeft 18.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 10.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 17, Autocluster: 4, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot11@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot11@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#11#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.16 test@<hostname> <IP:43885> preempting none <IP:36601> slot11@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=13.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(large.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot11@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot11@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00017: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 6.000000 pieLeft 17.000000 >03/25/14 13:51:22 Concurrency Limit: large.test is 11.000000 >03/25/14 13:51:22 Concurrency Limit large.test is 11.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:51:22 Rejected 1.17 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00025: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 6.000000 pieLeft 17.000000 >03/25/14 13:51:22 Concurrency Limit: medium.test is 1.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=17) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot12@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot12@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#12#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.25 test@<hostname> <IP:43885> preempting none <IP:36601> slot12@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=14.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot12@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot12@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00026: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 7.000000 pieLeft 16.000000 >03/25/14 13:51:22 Concurrency Limit: medium.test is 2.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 15, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot13@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot13@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#13#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.26 test@<hostname> <IP:43885> preempting none <IP:36601> slot13@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=15.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot13@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot13@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00027: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 8.000000 pieLeft 15.000000 >03/25/14 13:51:22 Concurrency Limit: medium.test is 3.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 14, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot14@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot14@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#14#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.27 test@<hostname> <IP:43885> preempting none <IP:36601> slot14@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=16.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot14@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot14@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00028: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 9.000000 pieLeft 14.000000 >03/25/14 13:51:22 Concurrency Limit: medium.test is 4.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 13, Autocluster: 7, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot15@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot15@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#15#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.28 test@<hostname> <IP:43885> preempting none <IP:36601> slot15@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=17.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot15@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot15@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00029: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 10.000000 pieLeft 13.000000 >03/25/14 13:51:22 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:51:22 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:22 Rejected 1.29 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00042: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 10.000000 pieLeft 13.000000 >03/25/14 13:51:22 Concurrency Limit: small.test is 1.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=13) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot17@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot17@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#17#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.42 test@<hostname> <IP:43885> preempting none <IP:36601> slot17@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=18.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(small.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot17@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot17@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00043: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 11.000000 pieLeft 12.000000 >03/25/14 13:51:22 Concurrency Limit: small.test is 2.000000 >03/25/14 13:51:22 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:51:22 Rejected 1.43 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00063: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 11.000000 pieLeft 12.000000 >03/25/14 13:51:22 Concurrency Limit: test is 0.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=12) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot18@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot18@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#18#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.63 test@<hostname> <IP:43885> preempting none <IP:36601> slot18@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=19.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot18@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot18@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00064: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 12.000000 pieLeft 11.000000 >03/25/14 13:51:22 Concurrency Limit: test is 1.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 10, Autocluster: 2, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot19@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot19@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#19#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.64 test@<hostname> <IP:43885> preempting none <IP:36601> slot19@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=20.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot19@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot19@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00065: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 13.000000 pieLeft 10.000000 >03/25/14 13:51:22 Concurrency Limit: test is 2.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 9, Autocluster: 2, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot20@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot20@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#20#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.65 test@<hostname> <IP:43885> preempting none <IP:36601> slot20@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=21.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot20@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot20@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00066: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 14.000000 pieLeft 9.000000 >03/25/14 13:51:22 Concurrency Limit: test is 3.000000 >03/25/14 13:51:22 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:51:22 Rejected 1.66 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00081: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 14.000000 pieLeft 9.000000 >03/25/14 13:51:22 Concurrency Limit: undef.test is 0.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=9) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot21@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot21@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#21#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.81 test@<hostname> <IP:43885> preempting none <IP:36601> slot21@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=22.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(undef.test) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot21@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot21@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00082: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 15.000000 pieLeft 8.000000 >03/25/14 13:51:22 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:51:22 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:22 Rejected 1.82 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00101: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 15.000000 pieLeft 8.000000 >03/25/14 13:51:22 Concurrency Limit: undef is 0.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=8) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot22@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot22@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#22#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.101 test@<hostname> <IP:43885> preempting none <IP:36601> slot22@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=23.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot22@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot22@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00102: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 16.000000 pieLeft 7.000000 >03/25/14 13:51:22 Concurrency Limit: undef is 1.000000 >03/25/14 13:51:22 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:22 Rejected 1.102 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00125: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 16.000000 pieLeft 7.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 0.000000 >03/25/14 13:51:22 Start of sorting MatchList (len=7) >03/25/14 13:51:22 Finished sorting MatchList >03/25/14 13:51:22 Connecting to startd slot23@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot23@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#23#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.125 test@<hostname> <IP:43885> preempting none <IP:36601> slot23@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=24.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot23@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot23@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00126: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 17.000000 pieLeft 6.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 1.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 5, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot25@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot25@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#25#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.126 test@<hostname> <IP:43885> preempting none <IP:36601> slot25@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=25.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot25@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot25@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00127: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 18.000000 pieLeft 5.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 2.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 4, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot26@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot26@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#26#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.127 test@<hostname> <IP:43885> preempting none <IP:36601> slot26@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=26.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot26@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot26@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00128: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 19.000000 pieLeft 4.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 3.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 3, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot27@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot27@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#27#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.128 test@<hostname> <IP:43885> preempting none <IP:36601> slot27@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=27.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot27@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot27@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00129: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 20.000000 pieLeft 3.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 4.000000 >03/25/14 13:51:22 Attempting to use cached MatchList: Succeeded. (MatchList length: 2, Autocluster: 6, Schedd Name: test@<hostname>, Schedd Address: <IP:43885>) >03/25/14 13:51:22 Connecting to startd slot28@<hostname> at <IP:36601> >03/25/14 13:51:22 Sending MATCH_INFO/claim id to slot28@<hostname> >03/25/14 13:51:22 (Claim ID is "<IP:36601>#1395751830#28#..." ) >03/25/14 13:51:22 Sending PERMISSION, claim id, startdAd to schedd >03/25/14 13:51:22 Matched 1.129 test@<hostname> <IP:43885> preempting none <IP:36601> slot28@<hostname> >03/25/14 13:51:22 Notifying the accountant >03/25/14 13:51:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:51:22 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:22 GroupWeightedResourcesUsed=28.000000 SlotWeight=1.000000 >03/25/14 13:51:22 IncrementLimit(medium.undef) >03/25/14 13:51:22 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot28@<hostname>@<IP:36601> >03/25/14 13:51:22 Successfully matched with slot28@<hostname> >03/25/14 13:51:22 Match completed, match cost= 1 >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:22 Request 00001.00130: >03/25/14 13:51:22 matchmakingAlgorithm: limit 23.000000 used 21.000000 pieLeft 2.000000 >03/25/14 13:51:22 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:51:22 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:22 Rejected 1.130 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:51:22 Sending SEND_JOB_INFO/eom >03/25/14 13:51:22 Getting reply from schedd ... >03/25/14 13:51:22 Got NO_MORE_JOBS; done negotiating >03/25/14 13:51:22 Submitter test@<hostname> got all it wants; removing it. >03/25/14 13:51:22 resources used by test@<hostname> are 28.000000 >03/25/14 13:51:22 resources used scheddUsed= 28.000000 >03/25/14 13:51:22 negotiateWithGroup resources used scheddAds length 0 >03/25/14 13:51:22 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:51:22 Getting monitoring info for pid 22893 >03/25/14 13:51:23 Getting monitoring info for pid 22893 >03/25/14 13:51:24 Getting monitoring info for pid 22893 >03/25/14 13:51:25 Getting monitoring info for pid 22893 >03/25/14 13:51:26 Getting monitoring info for pid 22893 >03/25/14 13:51:27 Getting monitoring info for pid 22893 >03/25/14 13:51:28 Getting monitoring info for pid 22893 >03/25/14 13:51:29 Getting monitoring info for pid 22893 >03/25/14 13:51:30 Getting monitoring info for pid 22893 >03/25/14 13:51:31 Getting monitoring info for pid 22893 >03/25/14 13:51:32 Getting monitoring info for pid 22893 >03/25/14 13:51:33 Getting monitoring info for pid 22893 >03/25/14 13:51:34 Getting monitoring info for pid 22893 >03/25/14 13:51:35 Getting monitoring info for pid 22893 >03/25/14 13:51:36 Getting monitoring info for pid 22893 >03/25/14 13:51:37 Getting monitoring info for pid 22893 >03/25/14 13:51:38 Getting monitoring info for pid 22893 >03/25/14 13:51:39 Getting monitoring info for pid 22893 >03/25/14 13:51:40 Getting monitoring info for pid 22893 >03/25/14 13:51:41 Getting monitoring info for pid 22893 >03/25/14 13:51:42 ---------- Started Negotiation Cycle ---------- >03/25/14 13:51:42 Phase 1: Obtaining ads from collector ... >03/25/14 13:51:42 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:51:42 Trying to query collector <IP:9618> >03/25/14 13:51:42 Sorting 32 ads ... >03/25/14 13:51:42 Getting startd private ads ... >03/25/14 13:51:42 Trying to query collector <IP:9618> >03/25/14 13:51:42 Got ads: 32 public and 30 private >03/25/14 13:51:42 Public ads include 1 submitter, 30 startd >03/25/14 13:51:42 Phase 2: Performing accounting ... >03/25/14 13:51:42 Entering compute_significant_attrs() >03/25/14 13:51:42 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:51:42 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:51:42 CustomerName=Customer.<none> , Old Priority=0.505 , New Priority=0.509 , ResourcesUsed=28 , WeightedResourcesUsed=28.000000 >03/25/14 13:51:42 RecentUsage= 28.000 (unweighted 28.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=1155.000 (unweighted 1155.000), BeginUsageTime=1395751882 >03/25/14 13:51:42 CustomerName=Customer.test@<hostname> , Old Priority=0.505 , New Priority=0.509 , ResourcesUsed=28 , WeightedResourcesUsed=28.000000 >03/25/14 13:51:42 RecentUsage= 28.000 (unweighted 28.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=1155.000 (unweighted 1155.000), BeginUsageTime=1395751882 >03/25/14 13:51:42 (Accountant) Checking Matches >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:51:42 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:42 GroupWeightedResourcesUsed=29.000000 SlotWeight=1.000000 >03/25/14 13:51:42 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot30@<hostname>@<IP:36601> >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:51:42 Customername test@<hostname> GroupName is: <none> >03/25/14 13:51:42 GroupWeightedResourcesUsed=30.000000 SlotWeight=1.000000 >03/25/14 13:51:42 (ACCOUNTANT) Added match between customer test@<hostname> and resource slot29@<hostname>@<IP:36601> >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:51:42 Match already existed! >03/25/14 13:51:42 Previous Limits -- >03/25/14 13:51:42 Limit: test = 3.000000 >03/25/14 13:51:42 Limit: small.test = 2.000000 >03/25/14 13:51:42 Limit: medium.test = 5.000000 >03/25/14 13:51:42 Limit: undef.test = 1.000000 >03/25/14 13:51:42 Limit: undef = 1.000000 >03/25/14 13:51:42 Limit: large.test = 11.000000 >03/25/14 13:51:42 Limit: medium.undef = 5.000000 >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(medium.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(medium.undef) >03/25/14 13:51:42 IncrementLimit(small.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(medium.undef) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(medium.undef) >03/25/14 13:51:42 IncrementLimit(medium.undef) >03/25/14 13:51:42 IncrementLimit(medium.undef) >03/25/14 13:51:42 IncrementLimit(small.test) >03/25/14 13:51:42 IncrementLimit(test) >03/25/14 13:51:42 IncrementLimit(medium.test) >03/25/14 13:51:42 IncrementLimit(test) >03/25/14 13:51:42 IncrementLimit(medium.test) >03/25/14 13:51:42 IncrementLimit(test) >03/25/14 13:51:42 IncrementLimit(medium.test) >03/25/14 13:51:42 IncrementLimit(undef.test) >03/25/14 13:51:42 IncrementLimit(medium.test) >03/25/14 13:51:42 IncrementLimit(undef) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 IncrementLimit(large.test) >03/25/14 13:51:42 Current Limits -- >03/25/14 13:51:42 Limit: test = 3.000000 >03/25/14 13:51:42 Limit: small.test = 2.000000 >03/25/14 13:51:42 Limit: medium.test = 5.000000 >03/25/14 13:51:42 Limit: undef.test = 1.000000 >03/25/14 13:51:42 Limit: undef = 1.000000 >03/25/14 13:51:42 Limit: large.test = 13.000000 >03/25/14 13:51:42 Limit: medium.undef = 5.000000 >03/25/14 13:51:42 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:51:42 Phase 4.1: Negotiating with schedds ... >03/25/14 13:51:42 numSlots = 30 >03/25/14 13:51:42 slotWeightTotal = 30.000000 >03/25/14 13:51:42 pieLeft = 0.000 >03/25/14 13:51:42 NormalFactor = 1.000000 >03/25/14 13:51:42 MaxPrioValue = 0.509097 >03/25/14 13:51:42 NumSubmitterAds = 1 >03/25/14 13:51:42 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:51:42 0 seconds so far >03/25/14 13:51:42 Calculating submitter limit with the following parameters >03/25/14 13:51:42 SubmitterPrio = 0.509097 >03/25/14 13:51:42 SubmitterPrioFactor = 1.000000 >03/25/14 13:51:42 submitterShare = 1.000000 >03/25/14 13:51:42 submitterAbsShare = 1.000000 >03/25/14 13:51:42 submitterLimit = 0.000000 >03/25/14 13:51:42 submitterUsage = 30.000000 >03/25/14 13:51:42 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:51:42 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00011: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: large.test is 13.000000 >03/25/14 13:51:42 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:51:42 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00025: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:51:42 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:42 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00042: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: small.test is 2.000000 >03/25/14 13:51:42 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:51:42 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00063: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: test is 3.000000 >03/25/14 13:51:42 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:51:42 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00081: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:51:42 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:42 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00101: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: undef is 1.000000 >03/25/14 13:51:42 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:51:42 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:51:42 Request 00001.00125: >03/25/14 13:51:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:51:42 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:51:42 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:51:42 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:51:42 Sending SEND_JOB_INFO/eom >03/25/14 13:51:42 Getting reply from schedd ... >03/25/14 13:51:42 Got NO_MORE_JOBS; done negotiating >03/25/14 13:51:42 This submitter hit its submitterLimit. >03/25/14 13:51:42 resources used scheddUsed= 30.000000 >03/25/14 13:51:42 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:51:42 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:51:42 Getting monitoring info for pid 22893 >03/25/14 13:51:43 Getting monitoring info for pid 22893 >03/25/14 13:51:44 Getting monitoring info for pid 22893 >03/25/14 13:51:45 Getting monitoring info for pid 22893 >03/25/14 13:51:46 Getting monitoring info for pid 22893 >03/25/14 13:51:47 Getting monitoring info for pid 22893 >03/25/14 13:51:48 Getting monitoring info for pid 22893 >03/25/14 13:51:49 Getting monitoring info for pid 22893 >03/25/14 13:51:50 Getting monitoring info for pid 22893 >03/25/14 13:51:51 Getting monitoring info for pid 22893 >03/25/14 13:51:52 Getting monitoring info for pid 22893 >03/25/14 13:51:53 Getting monitoring info for pid 22893 >03/25/14 13:51:54 Getting monitoring info for pid 22893 >03/25/14 13:51:55 Getting monitoring info for pid 22893 >03/25/14 13:51:56 Getting monitoring info for pid 22893 >03/25/14 13:51:57 Getting monitoring info for pid 22893 >03/25/14 13:51:58 Getting monitoring info for pid 22893 >03/25/14 13:51:59 Getting monitoring info for pid 22893 >03/25/14 13:52:00 Getting monitoring info for pid 22893 >03/25/14 13:52:01 Getting monitoring info for pid 22893 >03/25/14 13:52:01 IPVERIFY: checking <hostname> against IP >03/25/14 13:52:01 IPVERIFY: matched IP to IP >03/25/14 13:52:01 IPVERIFY: ip found is 1 >03/25/14 13:52:01 IPVERIFY: checking lt-rhel6_64 against IP >03/25/14 13:52:01 IPVERIFY: matched IP to IP >03/25/14 13:52:01 IPVERIFY: ip found is 1 >03/25/14 13:52:01 Adding to resolved authorization table: unauthenticated@unmapped/IP: READ >03/25/14 13:52:01 Getting state information from the accountant >03/25/14 13:52:01 Reporting State >03/25/14 13:52:02 ---------- Started Negotiation Cycle ---------- >03/25/14 13:52:02 Phase 1: Obtaining ads from collector ... >03/25/14 13:52:02 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:52:02 Trying to query collector <IP:9618> >03/25/14 13:52:02 Sorting 32 ads ... >03/25/14 13:52:02 Getting startd private ads ... >03/25/14 13:52:02 Trying to query collector <IP:9618> >03/25/14 13:52:02 Got ads: 32 public and 30 private >03/25/14 13:52:02 Public ads include 1 submitter, 30 startd >03/25/14 13:52:02 Phase 2: Performing accounting ... >03/25/14 13:52:02 Entering compute_significant_attrs() >03/25/14 13:52:02 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:52:02 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:52:02 CustomerName=Customer.<none> , Old Priority=0.509 , New Priority=0.514 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=1755.000 (unweighted 1755.000), BeginUsageTime=1395751882 >03/25/14 13:52:02 CustomerName=Customer.test@<hostname> , Old Priority=0.509 , New Priority=0.514 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=1755.000 (unweighted 1755.000), BeginUsageTime=1395751882 >03/25/14 13:52:02 (Accountant) Checking Matches >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:52:02 Match already existed! >03/25/14 13:52:02 Previous Limits -- >03/25/14 13:52:02 Limit: test = 3.000000 >03/25/14 13:52:02 Limit: small.test = 2.000000 >03/25/14 13:52:02 Limit: medium.test = 5.000000 >03/25/14 13:52:02 Limit: undef.test = 1.000000 >03/25/14 13:52:02 Limit: undef = 1.000000 >03/25/14 13:52:02 Limit: large.test = 13.000000 >03/25/14 13:52:02 Limit: medium.undef = 5.000000 >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(medium.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(medium.undef) >03/25/14 13:52:02 IncrementLimit(small.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(medium.undef) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(medium.undef) >03/25/14 13:52:02 IncrementLimit(medium.undef) >03/25/14 13:52:02 IncrementLimit(medium.undef) >03/25/14 13:52:02 IncrementLimit(small.test) >03/25/14 13:52:02 IncrementLimit(test) >03/25/14 13:52:02 IncrementLimit(medium.test) >03/25/14 13:52:02 IncrementLimit(test) >03/25/14 13:52:02 IncrementLimit(medium.test) >03/25/14 13:52:02 IncrementLimit(test) >03/25/14 13:52:02 IncrementLimit(medium.test) >03/25/14 13:52:02 IncrementLimit(undef.test) >03/25/14 13:52:02 IncrementLimit(medium.test) >03/25/14 13:52:02 IncrementLimit(undef) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 IncrementLimit(large.test) >03/25/14 13:52:02 Current Limits -- >03/25/14 13:52:02 Limit: test = 3.000000 >03/25/14 13:52:02 Limit: small.test = 2.000000 >03/25/14 13:52:02 Limit: medium.test = 5.000000 >03/25/14 13:52:02 Limit: undef.test = 1.000000 >03/25/14 13:52:02 Limit: undef = 1.000000 >03/25/14 13:52:02 Limit: large.test = 13.000000 >03/25/14 13:52:02 Limit: medium.undef = 5.000000 >03/25/14 13:52:02 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:52:02 Phase 4.1: Negotiating with schedds ... >03/25/14 13:52:02 numSlots = 30 >03/25/14 13:52:02 slotWeightTotal = 30.000000 >03/25/14 13:52:02 pieLeft = 0.000 >03/25/14 13:52:02 NormalFactor = 1.000000 >03/25/14 13:52:02 MaxPrioValue = 0.513829 >03/25/14 13:52:02 NumSubmitterAds = 1 >03/25/14 13:52:02 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:52:02 0 seconds so far >03/25/14 13:52:02 Calculating submitter limit with the following parameters >03/25/14 13:52:02 SubmitterPrio = 0.513829 >03/25/14 13:52:02 SubmitterPrioFactor = 1.000000 >03/25/14 13:52:02 submitterShare = 1.000000 >03/25/14 13:52:02 submitterAbsShare = 1.000000 >03/25/14 13:52:02 submitterLimit = 0.000000 >03/25/14 13:52:02 submitterUsage = 30.000000 >03/25/14 13:52:02 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:52:02 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00011: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: large.test is 13.000000 >03/25/14 13:52:02 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:52:02 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00025: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:52:02 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:02 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00042: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: small.test is 2.000000 >03/25/14 13:52:02 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:52:02 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00063: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: test is 3.000000 >03/25/14 13:52:02 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:52:02 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00081: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:52:02 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:02 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00101: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: undef is 1.000000 >03/25/14 13:52:02 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:02 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:02 Request 00001.00125: >03/25/14 13:52:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:02 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:52:02 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:02 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:52:02 Sending SEND_JOB_INFO/eom >03/25/14 13:52:02 Getting reply from schedd ... >03/25/14 13:52:02 Got NO_MORE_JOBS; done negotiating >03/25/14 13:52:02 This submitter hit its submitterLimit. >03/25/14 13:52:02 resources used scheddUsed= 30.000000 >03/25/14 13:52:02 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:52:02 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:52:02 Getting monitoring info for pid 22893 >03/25/14 13:52:03 Getting monitoring info for pid 22893 >03/25/14 13:52:04 Getting monitoring info for pid 22893 >03/25/14 13:52:05 Getting monitoring info for pid 22893 >03/25/14 13:52:06 Getting monitoring info for pid 22893 >03/25/14 13:52:07 Getting monitoring info for pid 22893 >03/25/14 13:52:09 Getting monitoring info for pid 22893 >03/25/14 13:52:10 Getting monitoring info for pid 22893 >03/25/14 13:52:11 Getting monitoring info for pid 22893 >03/25/14 13:52:12 Getting monitoring info for pid 22893 >03/25/14 13:52:13 Getting monitoring info for pid 22893 >03/25/14 13:52:14 Getting monitoring info for pid 22893 >03/25/14 13:52:15 Getting monitoring info for pid 22893 >03/25/14 13:52:16 Getting monitoring info for pid 22893 >03/25/14 13:52:17 Getting monitoring info for pid 22893 >03/25/14 13:52:18 Getting monitoring info for pid 22893 >03/25/14 13:52:19 Getting monitoring info for pid 22893 >03/25/14 13:52:20 Getting monitoring info for pid 22893 >03/25/14 13:52:21 Getting monitoring info for pid 22893 >03/25/14 13:52:22 ---------- Started Negotiation Cycle ---------- >03/25/14 13:52:22 Phase 1: Obtaining ads from collector ... >03/25/14 13:52:22 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:52:22 Trying to query collector <IP:9618> >03/25/14 13:52:22 Sorting 32 ads ... >03/25/14 13:52:22 Getting startd private ads ... >03/25/14 13:52:22 Trying to query collector <IP:9618> >03/25/14 13:52:22 Got ads: 32 public and 30 private >03/25/14 13:52:22 Public ads include 1 submitter, 30 startd >03/25/14 13:52:22 Phase 2: Performing accounting ... >03/25/14 13:52:22 Entering compute_significant_attrs() >03/25/14 13:52:22 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:52:22 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:52:22 CustomerName=Customer.<none> , Old Priority=0.514 , New Priority=0.519 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=2355.000 (unweighted 2355.000), BeginUsageTime=1395751882 >03/25/14 13:52:22 CustomerName=Customer.test@<hostname> , Old Priority=0.514 , New Priority=0.519 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=2355.000 (unweighted 2355.000), BeginUsageTime=1395751882 >03/25/14 13:52:22 (Accountant) Checking Matches >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:52:22 Match already existed! >03/25/14 13:52:22 Previous Limits -- >03/25/14 13:52:22 Limit: test = 3.000000 >03/25/14 13:52:22 Limit: small.test = 2.000000 >03/25/14 13:52:22 Limit: medium.test = 5.000000 >03/25/14 13:52:22 Limit: undef.test = 1.000000 >03/25/14 13:52:22 Limit: undef = 1.000000 >03/25/14 13:52:22 Limit: large.test = 13.000000 >03/25/14 13:52:22 Limit: medium.undef = 5.000000 >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(medium.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(medium.undef) >03/25/14 13:52:22 IncrementLimit(small.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(medium.undef) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(medium.undef) >03/25/14 13:52:22 IncrementLimit(medium.undef) >03/25/14 13:52:22 IncrementLimit(medium.undef) >03/25/14 13:52:22 IncrementLimit(small.test) >03/25/14 13:52:22 IncrementLimit(test) >03/25/14 13:52:22 IncrementLimit(medium.test) >03/25/14 13:52:22 IncrementLimit(test) >03/25/14 13:52:22 IncrementLimit(medium.test) >03/25/14 13:52:22 IncrementLimit(test) >03/25/14 13:52:22 IncrementLimit(medium.test) >03/25/14 13:52:22 IncrementLimit(undef.test) >03/25/14 13:52:22 IncrementLimit(medium.test) >03/25/14 13:52:22 IncrementLimit(undef) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 IncrementLimit(large.test) >03/25/14 13:52:22 Current Limits -- >03/25/14 13:52:22 Limit: test = 3.000000 >03/25/14 13:52:22 Limit: small.test = 2.000000 >03/25/14 13:52:22 Limit: medium.test = 5.000000 >03/25/14 13:52:22 Limit: undef.test = 1.000000 >03/25/14 13:52:22 Limit: undef = 1.000000 >03/25/14 13:52:22 Limit: large.test = 13.000000 >03/25/14 13:52:22 Limit: medium.undef = 5.000000 >03/25/14 13:52:22 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:52:22 Phase 4.1: Negotiating with schedds ... >03/25/14 13:52:22 numSlots = 30 >03/25/14 13:52:22 slotWeightTotal = 30.000000 >03/25/14 13:52:22 pieLeft = 0.000 >03/25/14 13:52:22 NormalFactor = 1.000000 >03/25/14 13:52:22 MaxPrioValue = 0.518560 >03/25/14 13:52:22 NumSubmitterAds = 1 >03/25/14 13:52:22 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:52:22 0 seconds so far >03/25/14 13:52:22 Calculating submitter limit with the following parameters >03/25/14 13:52:22 SubmitterPrio = 0.518560 >03/25/14 13:52:22 SubmitterPrioFactor = 1.000000 >03/25/14 13:52:22 submitterShare = 1.000000 >03/25/14 13:52:22 submitterAbsShare = 1.000000 >03/25/14 13:52:22 submitterLimit = 0.000000 >03/25/14 13:52:22 submitterUsage = 30.000000 >03/25/14 13:52:22 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:52:22 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00011: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: large.test is 13.000000 >03/25/14 13:52:22 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:52:22 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00025: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:52:22 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:22 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00042: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: small.test is 2.000000 >03/25/14 13:52:22 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:52:22 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00063: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: test is 3.000000 >03/25/14 13:52:22 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:52:22 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00081: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:52:22 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:22 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00101: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: undef is 1.000000 >03/25/14 13:52:22 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:22 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:22 Request 00001.00125: >03/25/14 13:52:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:22 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:52:22 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:22 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:52:22 Sending SEND_JOB_INFO/eom >03/25/14 13:52:22 Getting reply from schedd ... >03/25/14 13:52:22 Got NO_MORE_JOBS; done negotiating >03/25/14 13:52:22 This submitter hit its submitterLimit. >03/25/14 13:52:22 resources used scheddUsed= 30.000000 >03/25/14 13:52:22 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:52:22 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:52:22 Getting monitoring info for pid 22893 >03/25/14 13:52:23 Getting monitoring info for pid 22893 >03/25/14 13:52:24 Getting monitoring info for pid 22893 >03/25/14 13:52:25 Getting monitoring info for pid 22893 >03/25/14 13:52:26 Getting monitoring info for pid 22893 >03/25/14 13:52:27 Getting monitoring info for pid 22893 >03/25/14 13:52:28 Getting monitoring info for pid 22893 >03/25/14 13:52:29 Getting monitoring info for pid 22893 >03/25/14 13:52:30 Getting monitoring info for pid 22893 >03/25/14 13:52:31 Getting monitoring info for pid 22893 >03/25/14 13:52:32 Getting monitoring info for pid 22893 >03/25/14 13:52:33 Getting monitoring info for pid 22893 >03/25/14 13:52:34 Getting monitoring info for pid 22893 >03/25/14 13:52:35 Getting monitoring info for pid 22893 >03/25/14 13:52:36 Getting monitoring info for pid 22893 >03/25/14 13:52:37 Getting monitoring info for pid 22893 >03/25/14 13:52:38 Getting monitoring info for pid 22893 >03/25/14 13:52:39 Getting monitoring info for pid 22893 >03/25/14 13:52:40 Getting monitoring info for pid 22893 >03/25/14 13:52:41 Getting monitoring info for pid 22893 >03/25/14 13:52:42 ---------- Started Negotiation Cycle ---------- >03/25/14 13:52:42 Phase 1: Obtaining ads from collector ... >03/25/14 13:52:42 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:52:42 Trying to query collector <IP:9618> >03/25/14 13:52:42 Sorting 32 ads ... >03/25/14 13:52:42 Getting startd private ads ... >03/25/14 13:52:42 Trying to query collector <IP:9618> >03/25/14 13:52:42 Got ads: 32 public and 30 private >03/25/14 13:52:42 Public ads include 1 submitter, 30 startd >03/25/14 13:52:42 Phase 2: Performing accounting ... >03/25/14 13:52:42 Entering compute_significant_attrs() >03/25/14 13:52:42 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:52:42 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:52:42 CustomerName=Customer.<none> , Old Priority=0.519 , New Priority=0.523 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=2955.000 (unweighted 2955.000), BeginUsageTime=1395751882 >03/25/14 13:52:42 CustomerName=Customer.test@<hostname> , Old Priority=0.519 , New Priority=0.523 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:52:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=2955.000 (unweighted 2955.000), BeginUsageTime=1395751882 >03/25/14 13:52:42 (Accountant) Checking Matches >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:52:42 Match already existed! >03/25/14 13:52:42 Previous Limits -- >03/25/14 13:52:42 Limit: test = 3.000000 >03/25/14 13:52:42 Limit: small.test = 2.000000 >03/25/14 13:52:42 Limit: medium.test = 5.000000 >03/25/14 13:52:42 Limit: undef.test = 1.000000 >03/25/14 13:52:42 Limit: undef = 1.000000 >03/25/14 13:52:42 Limit: large.test = 13.000000 >03/25/14 13:52:42 Limit: medium.undef = 5.000000 >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(medium.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(medium.undef) >03/25/14 13:52:42 IncrementLimit(small.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(medium.undef) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(medium.undef) >03/25/14 13:52:42 IncrementLimit(medium.undef) >03/25/14 13:52:42 IncrementLimit(medium.undef) >03/25/14 13:52:42 IncrementLimit(small.test) >03/25/14 13:52:42 IncrementLimit(test) >03/25/14 13:52:42 IncrementLimit(medium.test) >03/25/14 13:52:42 IncrementLimit(test) >03/25/14 13:52:42 IncrementLimit(medium.test) >03/25/14 13:52:42 IncrementLimit(test) >03/25/14 13:52:42 IncrementLimit(medium.test) >03/25/14 13:52:42 IncrementLimit(undef.test) >03/25/14 13:52:42 IncrementLimit(medium.test) >03/25/14 13:52:42 IncrementLimit(undef) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 IncrementLimit(large.test) >03/25/14 13:52:42 Current Limits -- >03/25/14 13:52:42 Limit: test = 3.000000 >03/25/14 13:52:42 Limit: small.test = 2.000000 >03/25/14 13:52:42 Limit: medium.test = 5.000000 >03/25/14 13:52:42 Limit: undef.test = 1.000000 >03/25/14 13:52:42 Limit: undef = 1.000000 >03/25/14 13:52:42 Limit: large.test = 13.000000 >03/25/14 13:52:42 Limit: medium.undef = 5.000000 >03/25/14 13:52:42 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:52:42 Phase 4.1: Negotiating with schedds ... >03/25/14 13:52:42 numSlots = 30 >03/25/14 13:52:42 slotWeightTotal = 30.000000 >03/25/14 13:52:42 pieLeft = 0.000 >03/25/14 13:52:42 NormalFactor = 1.000000 >03/25/14 13:52:42 MaxPrioValue = 0.523290 >03/25/14 13:52:42 NumSubmitterAds = 1 >03/25/14 13:52:42 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:52:42 0 seconds so far >03/25/14 13:52:42 Calculating submitter limit with the following parameters >03/25/14 13:52:42 SubmitterPrio = 0.523290 >03/25/14 13:52:42 SubmitterPrioFactor = 1.000000 >03/25/14 13:52:42 submitterShare = 1.000000 >03/25/14 13:52:42 submitterAbsShare = 1.000000 >03/25/14 13:52:42 submitterLimit = 0.000000 >03/25/14 13:52:42 submitterUsage = 30.000000 >03/25/14 13:52:42 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:52:42 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00011: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: large.test is 13.000000 >03/25/14 13:52:42 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:52:42 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00025: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:52:42 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:42 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00042: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: small.test is 2.000000 >03/25/14 13:52:42 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:52:42 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00063: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: test is 3.000000 >03/25/14 13:52:42 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:52:42 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00081: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:52:42 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:42 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00101: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: undef is 1.000000 >03/25/14 13:52:42 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:52:42 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got JOB_INFO command; getting classad/eom >03/25/14 13:52:42 Request 00001.00125: >03/25/14 13:52:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:52:42 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:52:42 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:52:42 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:52:42 Sending SEND_JOB_INFO/eom >03/25/14 13:52:42 Getting reply from schedd ... >03/25/14 13:52:42 Got NO_MORE_JOBS; done negotiating >03/25/14 13:52:42 This submitter hit its submitterLimit. >03/25/14 13:52:42 resources used scheddUsed= 30.000000 >03/25/14 13:52:42 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:52:42 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:52:42 Getting monitoring info for pid 22893 >03/25/14 13:52:43 Getting monitoring info for pid 22893 >03/25/14 13:52:44 Getting monitoring info for pid 22893 >03/25/14 13:52:45 Getting monitoring info for pid 22893 >03/25/14 13:52:46 Getting monitoring info for pid 22893 >03/25/14 13:52:47 Getting monitoring info for pid 22893 >03/25/14 13:52:48 Getting monitoring info for pid 22893 >03/25/14 13:52:49 Getting monitoring info for pid 22893 >03/25/14 13:52:50 Getting monitoring info for pid 22893 >03/25/14 13:52:51 Getting monitoring info for pid 22893 >03/25/14 13:52:52 Getting monitoring info for pid 22893 >03/25/14 13:52:53 Getting monitoring info for pid 22893 >03/25/14 13:52:54 Getting monitoring info for pid 22893 >03/25/14 13:52:55 Getting monitoring info for pid 22893 >03/25/14 13:52:56 Getting monitoring info for pid 22893 >03/25/14 13:52:57 Getting monitoring info for pid 22893 >03/25/14 13:52:58 Getting monitoring info for pid 22893 >03/25/14 13:52:59 Getting monitoring info for pid 22893 >03/25/14 13:53:00 Getting monitoring info for pid 22893 >03/25/14 13:53:01 Getting monitoring info for pid 22893 >03/25/14 13:53:02 ---------- Started Negotiation Cycle ---------- >03/25/14 13:53:02 Phase 1: Obtaining ads from collector ... >03/25/14 13:53:02 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:53:02 Trying to query collector <IP:9618> >03/25/14 13:53:02 Sorting 32 ads ... >03/25/14 13:53:02 Getting startd private ads ... >03/25/14 13:53:02 Trying to query collector <IP:9618> >03/25/14 13:53:02 Got ads: 32 public and 30 private >03/25/14 13:53:02 Public ads include 1 submitter, 30 startd >03/25/14 13:53:02 Phase 2: Performing accounting ... >03/25/14 13:53:02 Entering compute_significant_attrs() >03/25/14 13:53:02 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:53:02 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:53:02 CustomerName=Customer.<none> , Old Priority=0.523 , New Priority=0.528 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=3555.000 (unweighted 3555.000), BeginUsageTime=1395751882 >03/25/14 13:53:02 CustomerName=Customer.test@<hostname> , Old Priority=0.523 , New Priority=0.528 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=3555.000 (unweighted 3555.000), BeginUsageTime=1395751882 >03/25/14 13:53:02 (Accountant) Checking Matches >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:53:02 Match already existed! >03/25/14 13:53:02 Previous Limits -- >03/25/14 13:53:02 Limit: test = 3.000000 >03/25/14 13:53:02 Limit: small.test = 2.000000 >03/25/14 13:53:02 Limit: medium.test = 5.000000 >03/25/14 13:53:02 Limit: undef.test = 1.000000 >03/25/14 13:53:02 Limit: undef = 1.000000 >03/25/14 13:53:02 Limit: large.test = 13.000000 >03/25/14 13:53:02 Limit: medium.undef = 5.000000 >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(medium.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(medium.undef) >03/25/14 13:53:02 IncrementLimit(small.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(medium.undef) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(medium.undef) >03/25/14 13:53:02 IncrementLimit(medium.undef) >03/25/14 13:53:02 IncrementLimit(medium.undef) >03/25/14 13:53:02 IncrementLimit(small.test) >03/25/14 13:53:02 IncrementLimit(test) >03/25/14 13:53:02 IncrementLimit(medium.test) >03/25/14 13:53:02 IncrementLimit(test) >03/25/14 13:53:02 IncrementLimit(medium.test) >03/25/14 13:53:02 IncrementLimit(test) >03/25/14 13:53:02 IncrementLimit(medium.test) >03/25/14 13:53:02 IncrementLimit(undef.test) >03/25/14 13:53:02 IncrementLimit(medium.test) >03/25/14 13:53:02 IncrementLimit(undef) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 IncrementLimit(large.test) >03/25/14 13:53:02 Current Limits -- >03/25/14 13:53:02 Limit: test = 3.000000 >03/25/14 13:53:02 Limit: small.test = 2.000000 >03/25/14 13:53:02 Limit: medium.test = 5.000000 >03/25/14 13:53:02 Limit: undef.test = 1.000000 >03/25/14 13:53:02 Limit: undef = 1.000000 >03/25/14 13:53:02 Limit: large.test = 13.000000 >03/25/14 13:53:02 Limit: medium.undef = 5.000000 >03/25/14 13:53:02 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:53:02 Phase 4.1: Negotiating with schedds ... >03/25/14 13:53:02 numSlots = 30 >03/25/14 13:53:02 slotWeightTotal = 30.000000 >03/25/14 13:53:02 pieLeft = 0.000 >03/25/14 13:53:02 NormalFactor = 1.000000 >03/25/14 13:53:02 MaxPrioValue = 0.528020 >03/25/14 13:53:02 NumSubmitterAds = 1 >03/25/14 13:53:02 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:53:02 0 seconds so far >03/25/14 13:53:02 Calculating submitter limit with the following parameters >03/25/14 13:53:02 SubmitterPrio = 0.528020 >03/25/14 13:53:02 SubmitterPrioFactor = 1.000000 >03/25/14 13:53:02 submitterShare = 1.000000 >03/25/14 13:53:02 submitterAbsShare = 1.000000 >03/25/14 13:53:02 submitterLimit = 0.000000 >03/25/14 13:53:02 submitterUsage = 30.000000 >03/25/14 13:53:02 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:53:02 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00011: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: large.test is 13.000000 >03/25/14 13:53:02 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:53:02 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00025: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:53:02 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:02 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00042: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: small.test is 2.000000 >03/25/14 13:53:02 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:53:02 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00063: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: test is 3.000000 >03/25/14 13:53:02 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:53:02 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00081: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:53:02 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:02 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00101: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: undef is 1.000000 >03/25/14 13:53:02 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:02 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:02 Request 00001.00125: >03/25/14 13:53:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:02 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:53:02 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:02 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:53:02 Sending SEND_JOB_INFO/eom >03/25/14 13:53:02 Getting reply from schedd ... >03/25/14 13:53:02 Got NO_MORE_JOBS; done negotiating >03/25/14 13:53:02 This submitter hit its submitterLimit. >03/25/14 13:53:02 resources used scheddUsed= 30.000000 >03/25/14 13:53:02 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:53:02 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:53:02 Getting monitoring info for pid 22893 >03/25/14 13:53:03 Getting monitoring info for pid 22893 >03/25/14 13:53:04 Getting monitoring info for pid 22893 >03/25/14 13:53:05 Getting monitoring info for pid 22893 >03/25/14 13:53:06 Getting monitoring info for pid 22893 >03/25/14 13:53:07 Getting monitoring info for pid 22893 >03/25/14 13:53:08 Getting monitoring info for pid 22893 >03/25/14 13:53:09 Getting monitoring info for pid 22893 >03/25/14 13:53:10 Getting monitoring info for pid 22893 >03/25/14 13:53:11 Getting monitoring info for pid 22893 >03/25/14 13:53:12 Getting monitoring info for pid 22893 >03/25/14 13:53:13 Getting monitoring info for pid 22893 >03/25/14 13:53:14 Getting monitoring info for pid 22893 >03/25/14 13:53:15 Getting monitoring info for pid 22893 >03/25/14 13:53:16 Getting monitoring info for pid 22893 >03/25/14 13:53:17 Getting monitoring info for pid 22893 >03/25/14 13:53:18 Getting monitoring info for pid 22893 >03/25/14 13:53:19 Getting monitoring info for pid 22893 >03/25/14 13:53:20 Getting monitoring info for pid 22893 >03/25/14 13:53:21 Getting monitoring info for pid 22893 >03/25/14 13:53:22 ---------- Started Negotiation Cycle ---------- >03/25/14 13:53:22 Phase 1: Obtaining ads from collector ... >03/25/14 13:53:22 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:53:22 Trying to query collector <IP:9618> >03/25/14 13:53:22 Sorting 32 ads ... >03/25/14 13:53:22 Getting startd private ads ... >03/25/14 13:53:22 Trying to query collector <IP:9618> >03/25/14 13:53:22 Got ads: 32 public and 30 private >03/25/14 13:53:22 Public ads include 1 submitter, 30 startd >03/25/14 13:53:22 Phase 2: Performing accounting ... >03/25/14 13:53:22 Entering compute_significant_attrs() >03/25/14 13:53:22 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:53:22 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:53:22 CustomerName=Customer.<none> , Old Priority=0.528 , New Priority=0.533 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=4155.000 (unweighted 4155.000), BeginUsageTime=1395751882 >03/25/14 13:53:22 CustomerName=Customer.test@<hostname> , Old Priority=0.528 , New Priority=0.533 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=4155.000 (unweighted 4155.000), BeginUsageTime=1395751882 >03/25/14 13:53:22 (Accountant) Checking Matches >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:53:22 Match already existed! >03/25/14 13:53:22 Previous Limits -- >03/25/14 13:53:22 Limit: test = 3.000000 >03/25/14 13:53:22 Limit: small.test = 2.000000 >03/25/14 13:53:22 Limit: medium.test = 5.000000 >03/25/14 13:53:22 Limit: undef.test = 1.000000 >03/25/14 13:53:22 Limit: undef = 1.000000 >03/25/14 13:53:22 Limit: large.test = 13.000000 >03/25/14 13:53:22 Limit: medium.undef = 5.000000 >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(medium.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(medium.undef) >03/25/14 13:53:22 IncrementLimit(small.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(medium.undef) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(medium.undef) >03/25/14 13:53:22 IncrementLimit(medium.undef) >03/25/14 13:53:22 IncrementLimit(medium.undef) >03/25/14 13:53:22 IncrementLimit(small.test) >03/25/14 13:53:22 IncrementLimit(test) >03/25/14 13:53:22 IncrementLimit(medium.test) >03/25/14 13:53:22 IncrementLimit(test) >03/25/14 13:53:22 IncrementLimit(medium.test) >03/25/14 13:53:22 IncrementLimit(test) >03/25/14 13:53:22 IncrementLimit(medium.test) >03/25/14 13:53:22 IncrementLimit(undef.test) >03/25/14 13:53:22 IncrementLimit(medium.test) >03/25/14 13:53:22 IncrementLimit(undef) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 IncrementLimit(large.test) >03/25/14 13:53:22 Current Limits -- >03/25/14 13:53:22 Limit: test = 3.000000 >03/25/14 13:53:22 Limit: small.test = 2.000000 >03/25/14 13:53:22 Limit: medium.test = 5.000000 >03/25/14 13:53:22 Limit: undef.test = 1.000000 >03/25/14 13:53:22 Limit: undef = 1.000000 >03/25/14 13:53:22 Limit: large.test = 13.000000 >03/25/14 13:53:22 Limit: medium.undef = 5.000000 >03/25/14 13:53:22 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:53:22 Phase 4.1: Negotiating with schedds ... >03/25/14 13:53:22 numSlots = 30 >03/25/14 13:53:22 slotWeightTotal = 30.000000 >03/25/14 13:53:22 pieLeft = 0.000 >03/25/14 13:53:22 NormalFactor = 1.000000 >03/25/14 13:53:22 MaxPrioValue = 0.532749 >03/25/14 13:53:22 NumSubmitterAds = 1 >03/25/14 13:53:22 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:53:22 0 seconds so far >03/25/14 13:53:22 Calculating submitter limit with the following parameters >03/25/14 13:53:22 SubmitterPrio = 0.532749 >03/25/14 13:53:22 SubmitterPrioFactor = 1.000000 >03/25/14 13:53:22 submitterShare = 1.000000 >03/25/14 13:53:22 submitterAbsShare = 1.000000 >03/25/14 13:53:22 submitterLimit = 0.000000 >03/25/14 13:53:22 submitterUsage = 30.000000 >03/25/14 13:53:22 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:53:22 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00011: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: large.test is 13.000000 >03/25/14 13:53:22 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:53:22 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00025: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:53:22 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:22 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00042: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: small.test is 2.000000 >03/25/14 13:53:22 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:53:22 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00063: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: test is 3.000000 >03/25/14 13:53:22 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:53:22 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00081: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:53:22 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:22 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00101: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: undef is 1.000000 >03/25/14 13:53:22 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:22 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:22 Request 00001.00125: >03/25/14 13:53:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:22 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:53:22 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:22 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:53:22 Sending SEND_JOB_INFO/eom >03/25/14 13:53:22 Getting reply from schedd ... >03/25/14 13:53:22 Got NO_MORE_JOBS; done negotiating >03/25/14 13:53:22 This submitter hit its submitterLimit. >03/25/14 13:53:22 resources used scheddUsed= 30.000000 >03/25/14 13:53:22 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:53:22 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:53:22 Getting monitoring info for pid 22893 >03/25/14 13:53:23 Getting monitoring info for pid 22893 >03/25/14 13:53:24 Getting monitoring info for pid 22893 >03/25/14 13:53:25 Getting monitoring info for pid 22893 >03/25/14 13:53:26 Getting monitoring info for pid 22893 >03/25/14 13:53:27 Getting monitoring info for pid 22893 >03/25/14 13:53:28 Getting monitoring info for pid 22893 >03/25/14 13:53:29 Getting monitoring info for pid 22893 >03/25/14 13:53:30 Getting monitoring info for pid 22893 >03/25/14 13:53:31 Getting monitoring info for pid 22893 >03/25/14 13:53:32 Getting monitoring info for pid 22893 >03/25/14 13:53:33 Getting monitoring info for pid 22893 >03/25/14 13:53:34 Getting monitoring info for pid 22893 >03/25/14 13:53:35 Getting monitoring info for pid 22893 >03/25/14 13:53:36 Getting monitoring info for pid 22893 >03/25/14 13:53:37 Getting monitoring info for pid 22893 >03/25/14 13:53:38 Getting monitoring info for pid 22893 >03/25/14 13:53:39 Getting monitoring info for pid 22893 >03/25/14 13:53:40 Getting monitoring info for pid 22893 >03/25/14 13:53:41 Getting monitoring info for pid 22893 >03/25/14 13:53:42 ---------- Started Negotiation Cycle ---------- >03/25/14 13:53:42 Phase 1: Obtaining ads from collector ... >03/25/14 13:53:42 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:53:42 Trying to query collector <IP:9618> >03/25/14 13:53:43 Sorting 32 ads ... >03/25/14 13:53:43 Getting startd private ads ... >03/25/14 13:53:43 Trying to query collector <IP:9618> >03/25/14 13:53:43 Got ads: 32 public and 30 private >03/25/14 13:53:43 Public ads include 1 submitter, 30 startd >03/25/14 13:53:43 Phase 2: Performing accounting ... >03/25/14 13:53:43 Entering compute_significant_attrs() >03/25/14 13:53:43 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:53:43 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 13:53:43 CustomerName=Customer.<none> , Old Priority=0.533 , New Priority=0.538 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:43 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=4785.000 (unweighted 4785.000), BeginUsageTime=1395751882 >03/25/14 13:53:43 CustomerName=Customer.test@<hostname> , Old Priority=0.533 , New Priority=0.538 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:53:43 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=4785.000 (unweighted 4785.000), BeginUsageTime=1395751882 >03/25/14 13:53:43 (Accountant) Checking Matches >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:53:43 Match already existed! >03/25/14 13:53:43 Previous Limits -- >03/25/14 13:53:43 Limit: test = 3.000000 >03/25/14 13:53:43 Limit: small.test = 2.000000 >03/25/14 13:53:43 Limit: medium.test = 5.000000 >03/25/14 13:53:43 Limit: undef.test = 1.000000 >03/25/14 13:53:43 Limit: undef = 1.000000 >03/25/14 13:53:43 Limit: large.test = 13.000000 >03/25/14 13:53:43 Limit: medium.undef = 5.000000 >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(medium.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(medium.undef) >03/25/14 13:53:43 IncrementLimit(small.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(medium.undef) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(medium.undef) >03/25/14 13:53:43 IncrementLimit(medium.undef) >03/25/14 13:53:43 IncrementLimit(medium.undef) >03/25/14 13:53:43 IncrementLimit(small.test) >03/25/14 13:53:43 IncrementLimit(test) >03/25/14 13:53:43 IncrementLimit(medium.test) >03/25/14 13:53:43 IncrementLimit(test) >03/25/14 13:53:43 IncrementLimit(medium.test) >03/25/14 13:53:43 IncrementLimit(test) >03/25/14 13:53:43 IncrementLimit(medium.test) >03/25/14 13:53:43 IncrementLimit(undef.test) >03/25/14 13:53:43 IncrementLimit(medium.test) >03/25/14 13:53:43 IncrementLimit(undef) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 IncrementLimit(large.test) >03/25/14 13:53:43 Current Limits -- >03/25/14 13:53:43 Limit: test = 3.000000 >03/25/14 13:53:43 Limit: small.test = 2.000000 >03/25/14 13:53:43 Limit: medium.test = 5.000000 >03/25/14 13:53:43 Limit: undef.test = 1.000000 >03/25/14 13:53:43 Limit: undef = 1.000000 >03/25/14 13:53:43 Limit: large.test = 13.000000 >03/25/14 13:53:43 Limit: medium.undef = 5.000000 >03/25/14 13:53:43 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:53:43 Phase 4.1: Negotiating with schedds ... >03/25/14 13:53:43 numSlots = 30 >03/25/14 13:53:43 slotWeightTotal = 30.000000 >03/25/14 13:53:43 pieLeft = 0.000 >03/25/14 13:53:43 NormalFactor = 1.000000 >03/25/14 13:53:43 MaxPrioValue = 0.537713 >03/25/14 13:53:43 NumSubmitterAds = 1 >03/25/14 13:53:43 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:53:43 0 seconds so far >03/25/14 13:53:43 Calculating submitter limit with the following parameters >03/25/14 13:53:43 SubmitterPrio = 0.537713 >03/25/14 13:53:43 SubmitterPrioFactor = 1.000000 >03/25/14 13:53:43 submitterShare = 1.000000 >03/25/14 13:53:43 submitterAbsShare = 1.000000 >03/25/14 13:53:43 submitterLimit = 0.000000 >03/25/14 13:53:43 submitterUsage = 30.000000 >03/25/14 13:53:43 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:53:43 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00011: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: large.test is 13.000000 >03/25/14 13:53:43 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:53:43 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00025: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:53:43 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:43 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00042: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: small.test is 2.000000 >03/25/14 13:53:43 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:53:43 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00063: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: test is 3.000000 >03/25/14 13:53:43 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:53:43 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00081: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:53:43 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:43 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00101: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: undef is 1.000000 >03/25/14 13:53:43 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:53:43 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:53:43 Request 00001.00125: >03/25/14 13:53:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:53:43 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:53:43 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:53:43 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:53:43 Sending SEND_JOB_INFO/eom >03/25/14 13:53:43 Getting reply from schedd ... >03/25/14 13:53:43 Got NO_MORE_JOBS; done negotiating >03/25/14 13:53:43 This submitter hit its submitterLimit. >03/25/14 13:53:43 resources used scheddUsed= 30.000000 >03/25/14 13:53:43 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:53:43 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:53:43 Getting monitoring info for pid 22893 >03/25/14 13:53:44 Getting monitoring info for pid 22893 >03/25/14 13:53:45 Getting monitoring info for pid 22893 >03/25/14 13:53:46 Getting monitoring info for pid 22893 >03/25/14 13:53:47 Getting monitoring info for pid 22893 >03/25/14 13:53:48 Getting monitoring info for pid 22893 >03/25/14 13:53:49 Getting monitoring info for pid 22893 >03/25/14 13:53:50 Getting monitoring info for pid 22893 >03/25/14 13:53:51 Getting monitoring info for pid 22893 >03/25/14 13:53:52 Getting monitoring info for pid 22893 >03/25/14 13:53:53 Getting monitoring info for pid 22893 >03/25/14 13:53:54 Getting monitoring info for pid 22893 >03/25/14 13:53:55 Getting monitoring info for pid 22893 >03/25/14 13:53:56 Getting monitoring info for pid 22893 >03/25/14 13:53:57 Getting monitoring info for pid 22893 >03/25/14 13:53:58 Getting monitoring info for pid 22893 >03/25/14 13:53:59 Getting monitoring info for pid 22893 >03/25/14 13:54:00 Getting monitoring info for pid 22893 >03/25/14 13:54:01 Getting monitoring info for pid 22893 >03/25/14 13:54:02 Getting monitoring info for pid 22893 >03/25/14 13:54:03 ---------- Started Negotiation Cycle ---------- >03/25/14 13:54:03 Phase 1: Obtaining ads from collector ... >03/25/14 13:54:03 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:54:03 Trying to query collector <IP:9618> >03/25/14 13:54:03 Sorting 32 ads ... >03/25/14 13:54:03 Getting startd private ads ... >03/25/14 13:54:03 Trying to query collector <IP:9618> >03/25/14 13:54:03 Got ads: 32 public and 30 private >03/25/14 13:54:03 Public ads include 1 submitter, 30 startd >03/25/14 13:54:03 Phase 2: Performing accounting ... >03/25/14 13:54:03 Entering compute_significant_attrs() >03/25/14 13:54:03 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:54:03 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:54:03 CustomerName=Customer.<none> , Old Priority=0.538 , New Priority=0.542 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:03 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=5385.000 (unweighted 5385.000), BeginUsageTime=1395751882 >03/25/14 13:54:03 CustomerName=Customer.test@<hostname> , Old Priority=0.538 , New Priority=0.542 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:03 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=5385.000 (unweighted 5385.000), BeginUsageTime=1395751882 >03/25/14 13:54:03 (Accountant) Checking Matches >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:54:03 Match already existed! >03/25/14 13:54:03 Previous Limits -- >03/25/14 13:54:03 Limit: test = 3.000000 >03/25/14 13:54:03 Limit: small.test = 2.000000 >03/25/14 13:54:03 Limit: medium.test = 5.000000 >03/25/14 13:54:03 Limit: undef.test = 1.000000 >03/25/14 13:54:03 Limit: undef = 1.000000 >03/25/14 13:54:03 Limit: large.test = 13.000000 >03/25/14 13:54:03 Limit: medium.undef = 5.000000 >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(medium.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(medium.undef) >03/25/14 13:54:03 IncrementLimit(small.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(medium.undef) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(medium.undef) >03/25/14 13:54:03 IncrementLimit(medium.undef) >03/25/14 13:54:03 IncrementLimit(medium.undef) >03/25/14 13:54:03 IncrementLimit(small.test) >03/25/14 13:54:03 IncrementLimit(test) >03/25/14 13:54:03 IncrementLimit(medium.test) >03/25/14 13:54:03 IncrementLimit(test) >03/25/14 13:54:03 IncrementLimit(medium.test) >03/25/14 13:54:03 IncrementLimit(test) >03/25/14 13:54:03 IncrementLimit(medium.test) >03/25/14 13:54:03 IncrementLimit(undef.test) >03/25/14 13:54:03 IncrementLimit(medium.test) >03/25/14 13:54:03 IncrementLimit(undef) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 IncrementLimit(large.test) >03/25/14 13:54:03 Current Limits -- >03/25/14 13:54:03 Limit: test = 3.000000 >03/25/14 13:54:03 Limit: small.test = 2.000000 >03/25/14 13:54:03 Limit: medium.test = 5.000000 >03/25/14 13:54:03 Limit: undef.test = 1.000000 >03/25/14 13:54:03 Limit: undef = 1.000000 >03/25/14 13:54:03 Limit: large.test = 13.000000 >03/25/14 13:54:03 Limit: medium.undef = 5.000000 >03/25/14 13:54:03 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:54:03 Phase 4.1: Negotiating with schedds ... >03/25/14 13:54:03 numSlots = 30 >03/25/14 13:54:03 slotWeightTotal = 30.000000 >03/25/14 13:54:03 pieLeft = 0.000 >03/25/14 13:54:03 NormalFactor = 1.000000 >03/25/14 13:54:03 MaxPrioValue = 0.542440 >03/25/14 13:54:03 NumSubmitterAds = 1 >03/25/14 13:54:03 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:54:03 0 seconds so far >03/25/14 13:54:03 Calculating submitter limit with the following parameters >03/25/14 13:54:03 SubmitterPrio = 0.542440 >03/25/14 13:54:03 SubmitterPrioFactor = 1.000000 >03/25/14 13:54:03 submitterShare = 1.000000 >03/25/14 13:54:03 submitterAbsShare = 1.000000 >03/25/14 13:54:03 submitterLimit = 0.000000 >03/25/14 13:54:03 submitterUsage = 30.000000 >03/25/14 13:54:03 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:54:03 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00011: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: large.test is 13.000000 >03/25/14 13:54:03 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:54:03 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00025: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:54:03 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:03 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00042: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: small.test is 2.000000 >03/25/14 13:54:03 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:54:03 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00063: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: test is 3.000000 >03/25/14 13:54:03 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:54:03 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00081: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:54:03 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:03 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00101: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: undef is 1.000000 >03/25/14 13:54:03 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:03 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:03 Request 00001.00125: >03/25/14 13:54:03 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:03 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:54:03 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:03 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:54:03 Sending SEND_JOB_INFO/eom >03/25/14 13:54:03 Getting reply from schedd ... >03/25/14 13:54:03 Got NO_MORE_JOBS; done negotiating >03/25/14 13:54:03 This submitter hit its submitterLimit. >03/25/14 13:54:03 resources used scheddUsed= 30.000000 >03/25/14 13:54:03 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:54:03 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:54:03 Getting monitoring info for pid 22893 >03/25/14 13:54:04 Getting monitoring info for pid 22893 >03/25/14 13:54:05 Getting monitoring info for pid 22893 >03/25/14 13:54:06 Getting monitoring info for pid 22893 >03/25/14 13:54:07 Getting monitoring info for pid 22893 >03/25/14 13:54:08 Getting monitoring info for pid 22893 >03/25/14 13:54:09 Getting monitoring info for pid 22893 >03/25/14 13:54:10 Getting monitoring info for pid 22893 >03/25/14 13:54:11 Getting monitoring info for pid 22893 >03/25/14 13:54:12 Getting monitoring info for pid 22893 >03/25/14 13:54:13 Getting monitoring info for pid 22893 >03/25/14 13:54:14 Getting monitoring info for pid 22893 >03/25/14 13:54:15 Getting monitoring info for pid 22893 >03/25/14 13:54:16 Getting monitoring info for pid 22893 >03/25/14 13:54:17 Getting monitoring info for pid 22893 >03/25/14 13:54:18 Getting monitoring info for pid 22893 >03/25/14 13:54:19 Getting monitoring info for pid 22893 >03/25/14 13:54:20 Getting monitoring info for pid 22893 >03/25/14 13:54:21 Getting monitoring info for pid 22893 >03/25/14 13:54:22 Getting monitoring info for pid 22893 >03/25/14 13:54:23 ---------- Started Negotiation Cycle ---------- >03/25/14 13:54:23 Phase 1: Obtaining ads from collector ... >03/25/14 13:54:23 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:54:23 Trying to query collector <IP:9618> >03/25/14 13:54:23 Sorting 32 ads ... >03/25/14 13:54:23 Getting startd private ads ... >03/25/14 13:54:23 Trying to query collector <IP:9618> >03/25/14 13:54:23 Got ads: 32 public and 30 private >03/25/14 13:54:23 Public ads include 1 submitter, 30 startd >03/25/14 13:54:23 Phase 2: Performing accounting ... >03/25/14 13:54:23 Entering compute_significant_attrs() >03/25/14 13:54:23 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:54:23 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:54:23 CustomerName=Customer.<none> , Old Priority=0.542 , New Priority=0.547 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:23 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=5985.000 (unweighted 5985.000), BeginUsageTime=1395751882 >03/25/14 13:54:23 CustomerName=Customer.test@<hostname> , Old Priority=0.542 , New Priority=0.547 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:23 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=5985.000 (unweighted 5985.000), BeginUsageTime=1395751882 >03/25/14 13:54:23 (Accountant) Checking Matches >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:54:23 Match already existed! >03/25/14 13:54:23 Previous Limits -- >03/25/14 13:54:23 Limit: test = 3.000000 >03/25/14 13:54:23 Limit: small.test = 2.000000 >03/25/14 13:54:23 Limit: medium.test = 5.000000 >03/25/14 13:54:23 Limit: undef.test = 1.000000 >03/25/14 13:54:23 Limit: undef = 1.000000 >03/25/14 13:54:23 Limit: large.test = 13.000000 >03/25/14 13:54:23 Limit: medium.undef = 5.000000 >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(medium.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(medium.undef) >03/25/14 13:54:23 IncrementLimit(small.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(medium.undef) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(medium.undef) >03/25/14 13:54:23 IncrementLimit(medium.undef) >03/25/14 13:54:23 IncrementLimit(medium.undef) >03/25/14 13:54:23 IncrementLimit(small.test) >03/25/14 13:54:23 IncrementLimit(test) >03/25/14 13:54:23 IncrementLimit(medium.test) >03/25/14 13:54:23 IncrementLimit(test) >03/25/14 13:54:23 IncrementLimit(medium.test) >03/25/14 13:54:23 IncrementLimit(test) >03/25/14 13:54:23 IncrementLimit(medium.test) >03/25/14 13:54:23 IncrementLimit(undef.test) >03/25/14 13:54:23 IncrementLimit(medium.test) >03/25/14 13:54:23 IncrementLimit(undef) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 IncrementLimit(large.test) >03/25/14 13:54:23 Current Limits -- >03/25/14 13:54:23 Limit: test = 3.000000 >03/25/14 13:54:23 Limit: small.test = 2.000000 >03/25/14 13:54:23 Limit: medium.test = 5.000000 >03/25/14 13:54:23 Limit: undef.test = 1.000000 >03/25/14 13:54:23 Limit: undef = 1.000000 >03/25/14 13:54:23 Limit: large.test = 13.000000 >03/25/14 13:54:23 Limit: medium.undef = 5.000000 >03/25/14 13:54:23 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:54:23 Phase 4.1: Negotiating with schedds ... >03/25/14 13:54:23 numSlots = 30 >03/25/14 13:54:23 slotWeightTotal = 30.000000 >03/25/14 13:54:23 pieLeft = 0.000 >03/25/14 13:54:23 NormalFactor = 1.000000 >03/25/14 13:54:23 MaxPrioValue = 0.547167 >03/25/14 13:54:23 NumSubmitterAds = 1 >03/25/14 13:54:23 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:54:23 0 seconds so far >03/25/14 13:54:23 Calculating submitter limit with the following parameters >03/25/14 13:54:23 SubmitterPrio = 0.547167 >03/25/14 13:54:23 SubmitterPrioFactor = 1.000000 >03/25/14 13:54:23 submitterShare = 1.000000 >03/25/14 13:54:23 submitterAbsShare = 1.000000 >03/25/14 13:54:23 submitterLimit = 0.000000 >03/25/14 13:54:23 submitterUsage = 30.000000 >03/25/14 13:54:23 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:54:23 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00011: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: large.test is 13.000000 >03/25/14 13:54:23 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:54:23 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00025: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:54:23 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:23 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00042: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: small.test is 2.000000 >03/25/14 13:54:23 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:54:23 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00063: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: test is 3.000000 >03/25/14 13:54:23 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:54:23 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00081: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:54:23 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:23 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00101: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: undef is 1.000000 >03/25/14 13:54:23 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:23 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:23 Request 00001.00125: >03/25/14 13:54:23 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:23 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:54:23 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:23 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:54:23 Sending SEND_JOB_INFO/eom >03/25/14 13:54:23 Getting reply from schedd ... >03/25/14 13:54:23 Got NO_MORE_JOBS; done negotiating >03/25/14 13:54:23 This submitter hit its submitterLimit. >03/25/14 13:54:23 resources used scheddUsed= 30.000000 >03/25/14 13:54:23 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:54:23 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:54:23 Getting monitoring info for pid 22893 >03/25/14 13:54:24 Getting monitoring info for pid 22893 >03/25/14 13:54:25 Getting monitoring info for pid 22893 >03/25/14 13:54:26 Getting monitoring info for pid 22893 >03/25/14 13:54:27 Getting monitoring info for pid 22893 >03/25/14 13:54:28 Getting monitoring info for pid 22893 >03/25/14 13:54:29 Getting monitoring info for pid 22893 >03/25/14 13:54:30 Getting monitoring info for pid 22893 >03/25/14 13:54:31 Getting monitoring info for pid 22893 >03/25/14 13:54:32 Getting monitoring info for pid 22893 >03/25/14 13:54:33 Getting monitoring info for pid 22893 >03/25/14 13:54:34 Getting monitoring info for pid 22893 >03/25/14 13:54:35 Getting monitoring info for pid 22893 >03/25/14 13:54:36 Getting monitoring info for pid 22893 >03/25/14 13:54:37 Getting monitoring info for pid 22893 >03/25/14 13:54:38 Getting monitoring info for pid 22893 >03/25/14 13:54:39 Getting monitoring info for pid 22893 >03/25/14 13:54:40 Getting monitoring info for pid 22893 >03/25/14 13:54:41 Getting monitoring info for pid 22893 >03/25/14 13:54:42 Getting monitoring info for pid 22893 >03/25/14 13:54:43 ---------- Started Negotiation Cycle ---------- >03/25/14 13:54:43 Phase 1: Obtaining ads from collector ... >03/25/14 13:54:43 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:54:43 Trying to query collector <IP:9618> >03/25/14 13:54:43 Sorting 32 ads ... >03/25/14 13:54:43 Getting startd private ads ... >03/25/14 13:54:43 Trying to query collector <IP:9618> >03/25/14 13:54:43 Got ads: 32 public and 30 private >03/25/14 13:54:43 Public ads include 1 submitter, 30 startd >03/25/14 13:54:43 Phase 2: Performing accounting ... >03/25/14 13:54:43 Entering compute_significant_attrs() >03/25/14 13:54:43 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:54:43 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:54:43 CustomerName=Customer.<none> , Old Priority=0.547 , New Priority=0.552 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:43 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=6585.000 (unweighted 6585.000), BeginUsageTime=1395751882 >03/25/14 13:54:43 CustomerName=Customer.test@<hostname> , Old Priority=0.547 , New Priority=0.552 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:54:43 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=6585.000 (unweighted 6585.000), BeginUsageTime=1395751882 >03/25/14 13:54:43 (Accountant) Checking Matches >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:54:43 Match already existed! >03/25/14 13:54:43 Previous Limits -- >03/25/14 13:54:43 Limit: test = 3.000000 >03/25/14 13:54:43 Limit: small.test = 2.000000 >03/25/14 13:54:43 Limit: medium.test = 5.000000 >03/25/14 13:54:43 Limit: undef.test = 1.000000 >03/25/14 13:54:43 Limit: undef = 1.000000 >03/25/14 13:54:43 Limit: large.test = 13.000000 >03/25/14 13:54:43 Limit: medium.undef = 5.000000 >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(medium.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(medium.undef) >03/25/14 13:54:43 IncrementLimit(small.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(medium.undef) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(medium.undef) >03/25/14 13:54:43 IncrementLimit(medium.undef) >03/25/14 13:54:43 IncrementLimit(medium.undef) >03/25/14 13:54:43 IncrementLimit(small.test) >03/25/14 13:54:43 IncrementLimit(test) >03/25/14 13:54:43 IncrementLimit(medium.test) >03/25/14 13:54:43 IncrementLimit(test) >03/25/14 13:54:43 IncrementLimit(medium.test) >03/25/14 13:54:43 IncrementLimit(test) >03/25/14 13:54:43 IncrementLimit(medium.test) >03/25/14 13:54:43 IncrementLimit(undef.test) >03/25/14 13:54:43 IncrementLimit(medium.test) >03/25/14 13:54:43 IncrementLimit(undef) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 IncrementLimit(large.test) >03/25/14 13:54:43 Current Limits -- >03/25/14 13:54:43 Limit: test = 3.000000 >03/25/14 13:54:43 Limit: small.test = 2.000000 >03/25/14 13:54:43 Limit: medium.test = 5.000000 >03/25/14 13:54:43 Limit: undef.test = 1.000000 >03/25/14 13:54:43 Limit: undef = 1.000000 >03/25/14 13:54:43 Limit: large.test = 13.000000 >03/25/14 13:54:43 Limit: medium.undef = 5.000000 >03/25/14 13:54:43 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:54:43 Phase 4.1: Negotiating with schedds ... >03/25/14 13:54:43 numSlots = 30 >03/25/14 13:54:43 slotWeightTotal = 30.000000 >03/25/14 13:54:43 pieLeft = 0.000 >03/25/14 13:54:43 NormalFactor = 1.000000 >03/25/14 13:54:43 MaxPrioValue = 0.551893 >03/25/14 13:54:43 NumSubmitterAds = 1 >03/25/14 13:54:43 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:54:43 0 seconds so far >03/25/14 13:54:43 Calculating submitter limit with the following parameters >03/25/14 13:54:43 SubmitterPrio = 0.551893 >03/25/14 13:54:43 SubmitterPrioFactor = 1.000000 >03/25/14 13:54:43 submitterShare = 1.000000 >03/25/14 13:54:43 submitterAbsShare = 1.000000 >03/25/14 13:54:43 submitterLimit = 0.000000 >03/25/14 13:54:43 submitterUsage = 30.000000 >03/25/14 13:54:43 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:54:43 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00011: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: large.test is 13.000000 >03/25/14 13:54:43 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:54:43 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00025: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:54:43 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:43 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00042: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: small.test is 2.000000 >03/25/14 13:54:43 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:54:43 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00063: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: test is 3.000000 >03/25/14 13:54:43 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:54:43 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00081: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:54:43 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:43 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00101: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: undef is 1.000000 >03/25/14 13:54:43 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:54:43 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:43 Getting reply from schedd ... >03/25/14 13:54:43 Got JOB_INFO command; getting classad/eom >03/25/14 13:54:43 Request 00001.00125: >03/25/14 13:54:43 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:54:43 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:54:43 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:54:43 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:54:43 Sending SEND_JOB_INFO/eom >03/25/14 13:54:44 Getting reply from schedd ... >03/25/14 13:54:44 Got NO_MORE_JOBS; done negotiating >03/25/14 13:54:44 This submitter hit its submitterLimit. >03/25/14 13:54:44 resources used scheddUsed= 30.000000 >03/25/14 13:54:44 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:54:44 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:54:44 Getting monitoring info for pid 22893 >03/25/14 13:54:45 Getting monitoring info for pid 22893 >03/25/14 13:54:46 Getting monitoring info for pid 22893 >03/25/14 13:54:47 Getting monitoring info for pid 22893 >03/25/14 13:54:48 Getting monitoring info for pid 22893 >03/25/14 13:54:49 Getting monitoring info for pid 22893 >03/25/14 13:54:50 Getting monitoring info for pid 22893 >03/25/14 13:54:51 Getting monitoring info for pid 22893 >03/25/14 13:54:52 Getting monitoring info for pid 22893 >03/25/14 13:54:53 Getting monitoring info for pid 22893 >03/25/14 13:54:54 Getting monitoring info for pid 22893 >03/25/14 13:54:55 Getting monitoring info for pid 22893 >03/25/14 13:54:56 Getting monitoring info for pid 22893 >03/25/14 13:54:57 Getting monitoring info for pid 22893 >03/25/14 13:54:58 Getting monitoring info for pid 22893 >03/25/14 13:54:59 Getting monitoring info for pid 22893 >03/25/14 13:55:00 Getting monitoring info for pid 22893 >03/25/14 13:55:01 Getting monitoring info for pid 22893 >03/25/14 13:55:02 Getting monitoring info for pid 22893 >03/25/14 13:55:03 Getting monitoring info for pid 22893 >03/25/14 13:55:04 ---------- Started Negotiation Cycle ---------- >03/25/14 13:55:04 Phase 1: Obtaining ads from collector ... >03/25/14 13:55:04 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:55:04 Trying to query collector <IP:9618> >03/25/14 13:55:04 Sorting 32 ads ... >03/25/14 13:55:04 Getting startd private ads ... >03/25/14 13:55:04 Trying to query collector <IP:9618> >03/25/14 13:55:04 Got ads: 32 public and 30 private >03/25/14 13:55:04 Public ads include 1 submitter, 30 startd >03/25/14 13:55:04 Phase 2: Performing accounting ... >03/25/14 13:55:04 Entering compute_significant_attrs() >03/25/14 13:55:04 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:55:04 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 13:55:04 CustomerName=Customer.<none> , Old Priority=0.552 , New Priority=0.557 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:04 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=7215.000 (unweighted 7215.000), BeginUsageTime=1395751882 >03/25/14 13:55:04 CustomerName=Customer.test@<hostname> , Old Priority=0.552 , New Priority=0.557 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:04 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=7215.000 (unweighted 7215.000), BeginUsageTime=1395751882 >03/25/14 13:55:04 (Accountant) Checking Matches >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:55:04 Match already existed! >03/25/14 13:55:04 Previous Limits -- >03/25/14 13:55:04 Limit: test = 3.000000 >03/25/14 13:55:04 Limit: small.test = 2.000000 >03/25/14 13:55:04 Limit: medium.test = 5.000000 >03/25/14 13:55:04 Limit: undef.test = 1.000000 >03/25/14 13:55:04 Limit: undef = 1.000000 >03/25/14 13:55:04 Limit: large.test = 13.000000 >03/25/14 13:55:04 Limit: medium.undef = 5.000000 >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(medium.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(medium.undef) >03/25/14 13:55:04 IncrementLimit(small.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(medium.undef) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(medium.undef) >03/25/14 13:55:04 IncrementLimit(medium.undef) >03/25/14 13:55:04 IncrementLimit(medium.undef) >03/25/14 13:55:04 IncrementLimit(small.test) >03/25/14 13:55:04 IncrementLimit(test) >03/25/14 13:55:04 IncrementLimit(medium.test) >03/25/14 13:55:04 IncrementLimit(test) >03/25/14 13:55:04 IncrementLimit(medium.test) >03/25/14 13:55:04 IncrementLimit(test) >03/25/14 13:55:04 IncrementLimit(medium.test) >03/25/14 13:55:04 IncrementLimit(undef.test) >03/25/14 13:55:04 IncrementLimit(medium.test) >03/25/14 13:55:04 IncrementLimit(undef) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 IncrementLimit(large.test) >03/25/14 13:55:04 Current Limits -- >03/25/14 13:55:04 Limit: test = 3.000000 >03/25/14 13:55:04 Limit: small.test = 2.000000 >03/25/14 13:55:04 Limit: medium.test = 5.000000 >03/25/14 13:55:04 Limit: undef.test = 1.000000 >03/25/14 13:55:04 Limit: undef = 1.000000 >03/25/14 13:55:04 Limit: large.test = 13.000000 >03/25/14 13:55:04 Limit: medium.undef = 5.000000 >03/25/14 13:55:04 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:55:04 Phase 4.1: Negotiating with schedds ... >03/25/14 13:55:04 numSlots = 30 >03/25/14 13:55:04 slotWeightTotal = 30.000000 >03/25/14 13:55:04 pieLeft = 0.000 >03/25/14 13:55:04 NormalFactor = 1.000000 >03/25/14 13:55:04 MaxPrioValue = 0.556853 >03/25/14 13:55:04 NumSubmitterAds = 1 >03/25/14 13:55:04 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:55:04 0 seconds so far >03/25/14 13:55:04 Calculating submitter limit with the following parameters >03/25/14 13:55:04 SubmitterPrio = 0.556853 >03/25/14 13:55:04 SubmitterPrioFactor = 1.000000 >03/25/14 13:55:04 submitterShare = 1.000000 >03/25/14 13:55:04 submitterAbsShare = 1.000000 >03/25/14 13:55:04 submitterLimit = 0.000000 >03/25/14 13:55:04 submitterUsage = 30.000000 >03/25/14 13:55:04 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:55:04 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00011: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: large.test is 13.000000 >03/25/14 13:55:04 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:55:04 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00025: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:55:04 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:04 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00042: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: small.test is 2.000000 >03/25/14 13:55:04 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:55:04 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00063: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: test is 3.000000 >03/25/14 13:55:04 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:55:04 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00081: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:55:04 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:04 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00101: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: undef is 1.000000 >03/25/14 13:55:04 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:04 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:04 Request 00001.00125: >03/25/14 13:55:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:04 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:55:04 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:04 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:55:04 Sending SEND_JOB_INFO/eom >03/25/14 13:55:04 Getting reply from schedd ... >03/25/14 13:55:04 Got NO_MORE_JOBS; done negotiating >03/25/14 13:55:04 This submitter hit its submitterLimit. >03/25/14 13:55:04 resources used scheddUsed= 30.000000 >03/25/14 13:55:04 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:55:04 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:55:04 Getting monitoring info for pid 22893 >03/25/14 13:55:05 Getting monitoring info for pid 22893 >03/25/14 13:55:06 Getting monitoring info for pid 22893 >03/25/14 13:55:07 Getting monitoring info for pid 22893 >03/25/14 13:55:08 Getting monitoring info for pid 22893 >03/25/14 13:55:09 Getting monitoring info for pid 22893 >03/25/14 13:55:10 Getting monitoring info for pid 22893 >03/25/14 13:55:11 Getting monitoring info for pid 22893 >03/25/14 13:55:12 Getting monitoring info for pid 22893 >03/25/14 13:55:13 Getting monitoring info for pid 22893 >03/25/14 13:55:14 Getting monitoring info for pid 22893 >03/25/14 13:55:15 Getting monitoring info for pid 22893 >03/25/14 13:55:16 Getting monitoring info for pid 22893 >03/25/14 13:55:17 Getting monitoring info for pid 22893 >03/25/14 13:55:18 Getting monitoring info for pid 22893 >03/25/14 13:55:19 Getting monitoring info for pid 22893 >03/25/14 13:55:20 Getting monitoring info for pid 22893 >03/25/14 13:55:21 Getting monitoring info for pid 22893 >03/25/14 13:55:22 Getting monitoring info for pid 22893 >03/25/14 13:55:23 Getting monitoring info for pid 22893 >03/25/14 13:55:24 ---------- Started Negotiation Cycle ---------- >03/25/14 13:55:24 Phase 1: Obtaining ads from collector ... >03/25/14 13:55:24 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:55:24 Trying to query collector <IP:9618> >03/25/14 13:55:24 Sorting 32 ads ... >03/25/14 13:55:24 Getting startd private ads ... >03/25/14 13:55:24 Trying to query collector <IP:9618> >03/25/14 13:55:24 Got ads: 32 public and 30 private >03/25/14 13:55:24 Public ads include 1 submitter, 30 startd >03/25/14 13:55:24 Phase 2: Performing accounting ... >03/25/14 13:55:24 Entering compute_significant_attrs() >03/25/14 13:55:24 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:55:24 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:55:24 CustomerName=Customer.<none> , Old Priority=0.557 , New Priority=0.562 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:24 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=7815.000 (unweighted 7815.000), BeginUsageTime=1395751882 >03/25/14 13:55:24 CustomerName=Customer.test@<hostname> , Old Priority=0.557 , New Priority=0.562 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:24 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=7815.000 (unweighted 7815.000), BeginUsageTime=1395751882 >03/25/14 13:55:24 (Accountant) Checking Matches >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:55:24 Match already existed! >03/25/14 13:55:24 Previous Limits -- >03/25/14 13:55:24 Limit: test = 3.000000 >03/25/14 13:55:24 Limit: small.test = 2.000000 >03/25/14 13:55:24 Limit: medium.test = 5.000000 >03/25/14 13:55:24 Limit: undef.test = 1.000000 >03/25/14 13:55:24 Limit: undef = 1.000000 >03/25/14 13:55:24 Limit: large.test = 13.000000 >03/25/14 13:55:24 Limit: medium.undef = 5.000000 >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(medium.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(medium.undef) >03/25/14 13:55:24 IncrementLimit(small.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(medium.undef) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(medium.undef) >03/25/14 13:55:24 IncrementLimit(medium.undef) >03/25/14 13:55:24 IncrementLimit(medium.undef) >03/25/14 13:55:24 IncrementLimit(small.test) >03/25/14 13:55:24 IncrementLimit(test) >03/25/14 13:55:24 IncrementLimit(medium.test) >03/25/14 13:55:24 IncrementLimit(test) >03/25/14 13:55:24 IncrementLimit(medium.test) >03/25/14 13:55:24 IncrementLimit(test) >03/25/14 13:55:24 IncrementLimit(medium.test) >03/25/14 13:55:24 IncrementLimit(undef.test) >03/25/14 13:55:24 IncrementLimit(medium.test) >03/25/14 13:55:24 IncrementLimit(undef) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 IncrementLimit(large.test) >03/25/14 13:55:24 Current Limits -- >03/25/14 13:55:24 Limit: test = 3.000000 >03/25/14 13:55:24 Limit: small.test = 2.000000 >03/25/14 13:55:24 Limit: medium.test = 5.000000 >03/25/14 13:55:24 Limit: undef.test = 1.000000 >03/25/14 13:55:24 Limit: undef = 1.000000 >03/25/14 13:55:24 Limit: large.test = 13.000000 >03/25/14 13:55:24 Limit: medium.undef = 5.000000 >03/25/14 13:55:24 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:55:24 Phase 4.1: Negotiating with schedds ... >03/25/14 13:55:24 numSlots = 30 >03/25/14 13:55:24 slotWeightTotal = 30.000000 >03/25/14 13:55:24 pieLeft = 0.000 >03/25/14 13:55:24 NormalFactor = 1.000000 >03/25/14 13:55:24 MaxPrioValue = 0.561577 >03/25/14 13:55:24 NumSubmitterAds = 1 >03/25/14 13:55:24 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:55:24 0 seconds so far >03/25/14 13:55:24 Calculating submitter limit with the following parameters >03/25/14 13:55:24 SubmitterPrio = 0.561577 >03/25/14 13:55:24 SubmitterPrioFactor = 1.000000 >03/25/14 13:55:24 submitterShare = 1.000000 >03/25/14 13:55:24 submitterAbsShare = 1.000000 >03/25/14 13:55:24 submitterLimit = 0.000000 >03/25/14 13:55:24 submitterUsage = 30.000000 >03/25/14 13:55:24 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:55:24 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00011: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: large.test is 13.000000 >03/25/14 13:55:24 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:55:24 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00025: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:55:24 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:24 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00042: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: small.test is 2.000000 >03/25/14 13:55:24 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:55:24 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00063: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: test is 3.000000 >03/25/14 13:55:24 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:55:24 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00081: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:55:24 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:24 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00101: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: undef is 1.000000 >03/25/14 13:55:24 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:24 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:24 Request 00001.00125: >03/25/14 13:55:24 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:24 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:55:24 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:24 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:55:24 Sending SEND_JOB_INFO/eom >03/25/14 13:55:24 Getting reply from schedd ... >03/25/14 13:55:24 Got NO_MORE_JOBS; done negotiating >03/25/14 13:55:24 This submitter hit its submitterLimit. >03/25/14 13:55:24 resources used scheddUsed= 30.000000 >03/25/14 13:55:24 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:55:24 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:55:24 Getting monitoring info for pid 22893 >03/25/14 13:55:25 Getting monitoring info for pid 22893 >03/25/14 13:55:26 Getting monitoring info for pid 22893 >03/25/14 13:55:27 Getting monitoring info for pid 22893 >03/25/14 13:55:28 Getting monitoring info for pid 22893 >03/25/14 13:55:29 Getting monitoring info for pid 22893 >03/25/14 13:55:30 enter Matchmaker::updateCollector >03/25/14 13:55:30 Warning: Could not find DaemonStartTime >03/25/14 13:55:30 Trying to update collector <IP:9618> >03/25/14 13:55:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 13:55:30 exit Matchmaker::UpdateCollector >03/25/14 13:55:30 Getting monitoring info for pid 22893 >03/25/14 13:55:31 Getting monitoring info for pid 22893 >03/25/14 13:55:32 Getting monitoring info for pid 22893 >03/25/14 13:55:33 Getting monitoring info for pid 22893 >03/25/14 13:55:34 Getting monitoring info for pid 22893 >03/25/14 13:55:35 Getting monitoring info for pid 22893 >03/25/14 13:55:36 Getting monitoring info for pid 22893 >03/25/14 13:55:37 Getting monitoring info for pid 22893 >03/25/14 13:55:38 Getting monitoring info for pid 22893 >03/25/14 13:55:39 Getting monitoring info for pid 22893 >03/25/14 13:55:40 Getting monitoring info for pid 22893 >03/25/14 13:55:41 Getting monitoring info for pid 22893 >03/25/14 13:55:42 Getting monitoring info for pid 22893 >03/25/14 13:55:43 Getting monitoring info for pid 22893 >03/25/14 13:55:44 ---------- Started Negotiation Cycle ---------- >03/25/14 13:55:44 Phase 1: Obtaining ads from collector ... >03/25/14 13:55:44 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:55:44 Trying to query collector <IP:9618> >03/25/14 13:55:44 Sorting 32 ads ... >03/25/14 13:55:44 Getting startd private ads ... >03/25/14 13:55:44 Trying to query collector <IP:9618> >03/25/14 13:55:44 Got ads: 32 public and 30 private >03/25/14 13:55:44 Public ads include 1 submitter, 30 startd >03/25/14 13:55:44 Phase 2: Performing accounting ... >03/25/14 13:55:44 Entering compute_significant_attrs() >03/25/14 13:55:44 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:55:44 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:55:44 CustomerName=Customer.<none> , Old Priority=0.562 , New Priority=0.566 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:44 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=8415.000 (unweighted 8415.000), BeginUsageTime=1395751882 >03/25/14 13:55:44 CustomerName=Customer.test@<hostname> , Old Priority=0.562 , New Priority=0.566 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:55:44 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=8415.000 (unweighted 8415.000), BeginUsageTime=1395751882 >03/25/14 13:55:44 (Accountant) Checking Matches >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:55:44 Match already existed! >03/25/14 13:55:44 Previous Limits -- >03/25/14 13:55:44 Limit: test = 3.000000 >03/25/14 13:55:44 Limit: small.test = 2.000000 >03/25/14 13:55:44 Limit: medium.test = 5.000000 >03/25/14 13:55:44 Limit: undef.test = 1.000000 >03/25/14 13:55:44 Limit: undef = 1.000000 >03/25/14 13:55:44 Limit: large.test = 13.000000 >03/25/14 13:55:44 Limit: medium.undef = 5.000000 >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(medium.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(medium.undef) >03/25/14 13:55:44 IncrementLimit(small.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(medium.undef) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(medium.undef) >03/25/14 13:55:44 IncrementLimit(medium.undef) >03/25/14 13:55:44 IncrementLimit(small.test) >03/25/14 13:55:44 IncrementLimit(medium.undef) >03/25/14 13:55:44 IncrementLimit(test) >03/25/14 13:55:44 IncrementLimit(medium.test) >03/25/14 13:55:44 IncrementLimit(test) >03/25/14 13:55:44 IncrementLimit(medium.test) >03/25/14 13:55:44 IncrementLimit(test) >03/25/14 13:55:44 IncrementLimit(medium.test) >03/25/14 13:55:44 IncrementLimit(medium.test) >03/25/14 13:55:44 IncrementLimit(undef.test) >03/25/14 13:55:44 IncrementLimit(undef) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 IncrementLimit(large.test) >03/25/14 13:55:44 Current Limits -- >03/25/14 13:55:44 Limit: test = 3.000000 >03/25/14 13:55:44 Limit: small.test = 2.000000 >03/25/14 13:55:44 Limit: medium.test = 5.000000 >03/25/14 13:55:44 Limit: undef.test = 1.000000 >03/25/14 13:55:44 Limit: undef = 1.000000 >03/25/14 13:55:44 Limit: large.test = 13.000000 >03/25/14 13:55:44 Limit: medium.undef = 5.000000 >03/25/14 13:55:44 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:55:44 Phase 4.1: Negotiating with schedds ... >03/25/14 13:55:44 numSlots = 30 >03/25/14 13:55:44 slotWeightTotal = 30.000000 >03/25/14 13:55:44 pieLeft = 0.000 >03/25/14 13:55:44 NormalFactor = 1.000000 >03/25/14 13:55:44 MaxPrioValue = 0.566301 >03/25/14 13:55:44 NumSubmitterAds = 1 >03/25/14 13:55:44 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:55:44 0 seconds so far >03/25/14 13:55:44 Calculating submitter limit with the following parameters >03/25/14 13:55:44 SubmitterPrio = 0.566301 >03/25/14 13:55:44 SubmitterPrioFactor = 1.000000 >03/25/14 13:55:44 submitterShare = 1.000000 >03/25/14 13:55:44 submitterAbsShare = 1.000000 >03/25/14 13:55:44 submitterLimit = 0.000000 >03/25/14 13:55:44 submitterUsage = 30.000000 >03/25/14 13:55:44 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:55:44 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00011: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: large.test is 13.000000 >03/25/14 13:55:44 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:55:44 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00025: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:55:44 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:44 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00042: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: small.test is 2.000000 >03/25/14 13:55:44 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:55:44 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00063: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: test is 3.000000 >03/25/14 13:55:44 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:55:44 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00081: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:55:44 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:44 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00101: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: undef is 1.000000 >03/25/14 13:55:44 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:55:44 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got JOB_INFO command; getting classad/eom >03/25/14 13:55:44 Request 00001.00125: >03/25/14 13:55:44 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:55:44 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:55:44 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:55:44 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:55:44 Sending SEND_JOB_INFO/eom >03/25/14 13:55:44 Getting reply from schedd ... >03/25/14 13:55:44 Got NO_MORE_JOBS; done negotiating >03/25/14 13:55:44 This submitter hit its submitterLimit. >03/25/14 13:55:44 resources used scheddUsed= 30.000000 >03/25/14 13:55:44 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:55:44 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:55:44 Getting monitoring info for pid 22893 >03/25/14 13:55:45 Getting monitoring info for pid 22893 >03/25/14 13:55:46 Getting monitoring info for pid 22893 >03/25/14 13:55:47 Getting monitoring info for pid 22893 >03/25/14 13:55:48 Getting monitoring info for pid 22893 >03/25/14 13:55:49 Getting monitoring info for pid 22893 >03/25/14 13:55:50 Getting monitoring info for pid 22893 >03/25/14 13:55:51 Getting monitoring info for pid 22893 >03/25/14 13:55:52 Getting monitoring info for pid 22893 >03/25/14 13:55:53 Getting monitoring info for pid 22893 >03/25/14 13:55:54 Getting monitoring info for pid 22893 >03/25/14 13:55:55 Getting monitoring info for pid 22893 >03/25/14 13:55:56 Getting monitoring info for pid 22893 >03/25/14 13:55:57 Getting monitoring info for pid 22893 >03/25/14 13:55:58 Getting monitoring info for pid 22893 >03/25/14 13:55:59 Getting monitoring info for pid 22893 >03/25/14 13:56:00 Getting monitoring info for pid 22893 >03/25/14 13:56:01 Getting monitoring info for pid 22893 >03/25/14 13:56:02 Getting monitoring info for pid 22893 >03/25/14 13:56:03 Getting monitoring info for pid 22893 >03/25/14 13:56:04 ---------- Started Negotiation Cycle ---------- >03/25/14 13:56:04 Phase 1: Obtaining ads from collector ... >03/25/14 13:56:04 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:56:04 Trying to query collector <IP:9618> >03/25/14 13:56:04 Sorting 32 ads ... >03/25/14 13:56:04 Getting startd private ads ... >03/25/14 13:56:04 Trying to query collector <IP:9618> >03/25/14 13:56:04 Got ads: 32 public and 30 private >03/25/14 13:56:04 Public ads include 1 submitter, 30 startd >03/25/14 13:56:04 Phase 2: Performing accounting ... >03/25/14 13:56:04 Entering compute_significant_attrs() >03/25/14 13:56:04 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:56:04 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:56:04 CustomerName=Customer.<none> , Old Priority=0.566 , New Priority=0.571 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:04 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=9015.000 (unweighted 9015.000), BeginUsageTime=1395751882 >03/25/14 13:56:04 CustomerName=Customer.test@<hostname> , Old Priority=0.566 , New Priority=0.571 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:04 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=9015.000 (unweighted 9015.000), BeginUsageTime=1395751882 >03/25/14 13:56:04 (Accountant) Checking Matches >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:56:04 Match already existed! >03/25/14 13:56:04 Previous Limits -- >03/25/14 13:56:04 Limit: test = 3.000000 >03/25/14 13:56:04 Limit: small.test = 2.000000 >03/25/14 13:56:04 Limit: medium.test = 5.000000 >03/25/14 13:56:04 Limit: undef.test = 1.000000 >03/25/14 13:56:04 Limit: undef = 1.000000 >03/25/14 13:56:04 Limit: large.test = 13.000000 >03/25/14 13:56:04 Limit: medium.undef = 5.000000 >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(medium.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(medium.undef) >03/25/14 13:56:04 IncrementLimit(small.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(medium.undef) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(medium.undef) >03/25/14 13:56:04 IncrementLimit(medium.undef) >03/25/14 13:56:04 IncrementLimit(medium.undef) >03/25/14 13:56:04 IncrementLimit(small.test) >03/25/14 13:56:04 IncrementLimit(test) >03/25/14 13:56:04 IncrementLimit(medium.test) >03/25/14 13:56:04 IncrementLimit(test) >03/25/14 13:56:04 IncrementLimit(medium.test) >03/25/14 13:56:04 IncrementLimit(test) >03/25/14 13:56:04 IncrementLimit(medium.test) >03/25/14 13:56:04 IncrementLimit(undef.test) >03/25/14 13:56:04 IncrementLimit(medium.test) >03/25/14 13:56:04 IncrementLimit(undef) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 IncrementLimit(large.test) >03/25/14 13:56:04 Current Limits -- >03/25/14 13:56:04 Limit: test = 3.000000 >03/25/14 13:56:04 Limit: small.test = 2.000000 >03/25/14 13:56:04 Limit: medium.test = 5.000000 >03/25/14 13:56:04 Limit: undef.test = 1.000000 >03/25/14 13:56:04 Limit: undef = 1.000000 >03/25/14 13:56:04 Limit: large.test = 13.000000 >03/25/14 13:56:04 Limit: medium.undef = 5.000000 >03/25/14 13:56:04 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:56:04 Phase 4.1: Negotiating with schedds ... >03/25/14 13:56:04 numSlots = 30 >03/25/14 13:56:04 slotWeightTotal = 30.000000 >03/25/14 13:56:04 pieLeft = 0.000 >03/25/14 13:56:04 NormalFactor = 1.000000 >03/25/14 13:56:04 MaxPrioValue = 0.571024 >03/25/14 13:56:04 NumSubmitterAds = 1 >03/25/14 13:56:04 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:56:04 0 seconds so far >03/25/14 13:56:04 Calculating submitter limit with the following parameters >03/25/14 13:56:04 SubmitterPrio = 0.571024 >03/25/14 13:56:04 SubmitterPrioFactor = 1.000000 >03/25/14 13:56:04 submitterShare = 1.000000 >03/25/14 13:56:04 submitterAbsShare = 1.000000 >03/25/14 13:56:04 submitterLimit = 0.000000 >03/25/14 13:56:04 submitterUsage = 30.000000 >03/25/14 13:56:04 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:56:04 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00011: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: large.test is 13.000000 >03/25/14 13:56:04 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:56:04 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00025: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:56:04 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:04 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00042: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: small.test is 2.000000 >03/25/14 13:56:04 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:56:04 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00063: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: test is 3.000000 >03/25/14 13:56:04 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:56:04 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00081: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:56:04 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:04 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00101: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: undef is 1.000000 >03/25/14 13:56:04 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:04 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:04 Request 00001.00125: >03/25/14 13:56:04 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:04 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:56:04 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:04 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:56:04 Sending SEND_JOB_INFO/eom >03/25/14 13:56:04 Getting reply from schedd ... >03/25/14 13:56:04 Got NO_MORE_JOBS; done negotiating >03/25/14 13:56:04 This submitter hit its submitterLimit. >03/25/14 13:56:04 resources used scheddUsed= 30.000000 >03/25/14 13:56:04 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:56:04 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:56:04 Getting monitoring info for pid 22893 >03/25/14 13:56:05 Getting monitoring info for pid 22893 >03/25/14 13:56:06 Getting monitoring info for pid 22893 >03/25/14 13:56:07 Getting monitoring info for pid 22893 >03/25/14 13:56:08 Getting monitoring info for pid 22893 >03/25/14 13:56:09 Getting monitoring info for pid 22893 >03/25/14 13:56:10 Getting monitoring info for pid 22893 >03/25/14 13:56:11 Getting monitoring info for pid 22893 >03/25/14 13:56:12 Getting monitoring info for pid 22893 >03/25/14 13:56:13 Getting monitoring info for pid 22893 >03/25/14 13:56:14 Getting monitoring info for pid 22893 >03/25/14 13:56:15 Getting monitoring info for pid 22893 >03/25/14 13:56:16 Getting monitoring info for pid 22893 >03/25/14 13:56:17 Getting monitoring info for pid 22893 >03/25/14 13:56:18 Getting monitoring info for pid 22893 >03/25/14 13:56:19 Getting monitoring info for pid 22893 >03/25/14 13:56:20 Getting monitoring info for pid 22893 >03/25/14 13:56:21 Getting monitoring info for pid 22893 >03/25/14 13:56:22 Getting monitoring info for pid 22893 >03/25/14 13:56:23 Getting monitoring info for pid 22893 >03/25/14 13:56:24 ---------- Started Negotiation Cycle ---------- >03/25/14 13:56:24 Phase 1: Obtaining ads from collector ... >03/25/14 13:56:24 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:56:24 Trying to query collector <IP:9618> >03/25/14 13:56:24 Sorting 32 ads ... >03/25/14 13:56:24 Getting startd private ads ... >03/25/14 13:56:24 Trying to query collector <IP:9618> >03/25/14 13:56:24 Got ads: 32 public and 30 private >03/25/14 13:56:24 Public ads include 1 submitter, 30 startd >03/25/14 13:56:24 Phase 2: Performing accounting ... >03/25/14 13:56:24 Entering compute_significant_attrs() >03/25/14 13:56:24 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:56:24 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:56:24 CustomerName=Customer.<none> , Old Priority=0.571 , New Priority=0.576 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:24 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=9615.000 (unweighted 9615.000), BeginUsageTime=1395751882 >03/25/14 13:56:24 CustomerName=Customer.test@<hostname> , Old Priority=0.571 , New Priority=0.576 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:24 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=9615.000 (unweighted 9615.000), BeginUsageTime=1395751882 >03/25/14 13:56:24 (Accountant) Checking Matches >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:56:24 Match already existed! >03/25/14 13:56:24 Previous Limits -- >03/25/14 13:56:24 Limit: test = 3.000000 >03/25/14 13:56:24 Limit: small.test = 2.000000 >03/25/14 13:56:24 Limit: medium.test = 5.000000 >03/25/14 13:56:24 Limit: undef.test = 1.000000 >03/25/14 13:56:24 Limit: undef = 1.000000 >03/25/14 13:56:24 Limit: large.test = 13.000000 >03/25/14 13:56:24 Limit: medium.undef = 5.000000 >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(medium.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(medium.undef) >03/25/14 13:56:24 IncrementLimit(small.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(medium.undef) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(medium.undef) >03/25/14 13:56:24 IncrementLimit(medium.undef) >03/25/14 13:56:24 IncrementLimit(medium.undef) >03/25/14 13:56:24 IncrementLimit(small.test) >03/25/14 13:56:24 IncrementLimit(test) >03/25/14 13:56:24 IncrementLimit(medium.test) >03/25/14 13:56:24 IncrementLimit(test) >03/25/14 13:56:24 IncrementLimit(medium.test) >03/25/14 13:56:24 IncrementLimit(test) >03/25/14 13:56:24 IncrementLimit(medium.test) >03/25/14 13:56:24 IncrementLimit(undef.test) >03/25/14 13:56:24 IncrementLimit(medium.test) >03/25/14 13:56:24 IncrementLimit(undef) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 IncrementLimit(large.test) >03/25/14 13:56:24 Current Limits -- >03/25/14 13:56:24 Limit: test = 3.000000 >03/25/14 13:56:24 Limit: small.test = 2.000000 >03/25/14 13:56:24 Limit: medium.test = 5.000000 >03/25/14 13:56:24 Limit: undef.test = 1.000000 >03/25/14 13:56:24 Limit: undef = 1.000000 >03/25/14 13:56:24 Limit: large.test = 13.000000 >03/25/14 13:56:24 Limit: medium.undef = 5.000000 >03/25/14 13:56:25 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:56:25 Phase 4.1: Negotiating with schedds ... >03/25/14 13:56:25 numSlots = 30 >03/25/14 13:56:25 slotWeightTotal = 30.000000 >03/25/14 13:56:25 pieLeft = 0.000 >03/25/14 13:56:25 NormalFactor = 1.000000 >03/25/14 13:56:25 MaxPrioValue = 0.575746 >03/25/14 13:56:25 NumSubmitterAds = 1 >03/25/14 13:56:25 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:56:25 0 seconds so far >03/25/14 13:56:25 Calculating submitter limit with the following parameters >03/25/14 13:56:25 SubmitterPrio = 0.575746 >03/25/14 13:56:25 SubmitterPrioFactor = 1.000000 >03/25/14 13:56:25 submitterShare = 1.000000 >03/25/14 13:56:25 submitterAbsShare = 1.000000 >03/25/14 13:56:25 submitterLimit = 0.000000 >03/25/14 13:56:25 submitterUsage = 30.000000 >03/25/14 13:56:25 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:56:25 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00011: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: large.test is 13.000000 >03/25/14 13:56:25 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:56:25 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00025: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:56:25 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:25 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00042: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: small.test is 2.000000 >03/25/14 13:56:25 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:56:25 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00063: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: test is 3.000000 >03/25/14 13:56:25 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:56:25 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00081: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:56:25 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:25 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00101: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: undef is 1.000000 >03/25/14 13:56:25 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:25 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:25 Request 00001.00125: >03/25/14 13:56:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:25 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:56:25 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:25 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:56:25 Sending SEND_JOB_INFO/eom >03/25/14 13:56:25 Getting reply from schedd ... >03/25/14 13:56:25 Got NO_MORE_JOBS; done negotiating >03/25/14 13:56:25 This submitter hit its submitterLimit. >03/25/14 13:56:25 resources used scheddUsed= 30.000000 >03/25/14 13:56:25 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:56:25 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:56:25 Getting monitoring info for pid 22893 >03/25/14 13:56:26 Getting monitoring info for pid 22893 >03/25/14 13:56:27 Getting monitoring info for pid 22893 >03/25/14 13:56:28 Getting monitoring info for pid 22893 >03/25/14 13:56:29 Getting monitoring info for pid 22893 >03/25/14 13:56:30 Getting monitoring info for pid 22893 >03/25/14 13:56:31 Getting monitoring info for pid 22893 >03/25/14 13:56:32 Getting monitoring info for pid 22893 >03/25/14 13:56:33 Getting monitoring info for pid 22893 >03/25/14 13:56:34 Getting monitoring info for pid 22893 >03/25/14 13:56:35 Getting monitoring info for pid 22893 >03/25/14 13:56:36 Getting monitoring info for pid 22893 >03/25/14 13:56:37 Getting monitoring info for pid 22893 >03/25/14 13:56:38 Getting monitoring info for pid 22893 >03/25/14 13:56:39 Getting monitoring info for pid 22893 >03/25/14 13:56:40 Getting monitoring info for pid 22893 >03/25/14 13:56:41 Getting monitoring info for pid 22893 >03/25/14 13:56:42 Getting monitoring info for pid 22893 >03/25/14 13:56:43 Getting monitoring info for pid 22893 >03/25/14 13:56:44 Getting monitoring info for pid 22893 >03/25/14 13:56:45 ---------- Started Negotiation Cycle ---------- >03/25/14 13:56:45 Phase 1: Obtaining ads from collector ... >03/25/14 13:56:45 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:56:45 Trying to query collector <IP:9618> >03/25/14 13:56:45 Sorting 32 ads ... >03/25/14 13:56:45 Getting startd private ads ... >03/25/14 13:56:45 Trying to query collector <IP:9618> >03/25/14 13:56:45 Got ads: 32 public and 30 private >03/25/14 13:56:45 Public ads include 1 submitter, 30 startd >03/25/14 13:56:45 Phase 2: Performing accounting ... >03/25/14 13:56:45 Entering compute_significant_attrs() >03/25/14 13:56:45 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:56:45 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 13:56:45 CustomerName=Customer.<none> , Old Priority=0.576 , New Priority=0.581 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:45 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=10245.000 (unweighted 10245.000), BeginUsageTime=1395751882 >03/25/14 13:56:45 CustomerName=Customer.test@<hostname> , Old Priority=0.576 , New Priority=0.581 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:56:45 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=10245.000 (unweighted 10245.000), BeginUsageTime=1395751882 >03/25/14 13:56:45 (Accountant) Checking Matches >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:56:45 Match already existed! >03/25/14 13:56:45 Previous Limits -- >03/25/14 13:56:45 Limit: test = 3.000000 >03/25/14 13:56:45 Limit: small.test = 2.000000 >03/25/14 13:56:45 Limit: medium.test = 5.000000 >03/25/14 13:56:45 Limit: undef.test = 1.000000 >03/25/14 13:56:45 Limit: undef = 1.000000 >03/25/14 13:56:45 Limit: large.test = 13.000000 >03/25/14 13:56:45 Limit: medium.undef = 5.000000 >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(medium.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(medium.undef) >03/25/14 13:56:45 IncrementLimit(small.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(medium.undef) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(medium.undef) >03/25/14 13:56:45 IncrementLimit(medium.undef) >03/25/14 13:56:45 IncrementLimit(medium.undef) >03/25/14 13:56:45 IncrementLimit(small.test) >03/25/14 13:56:45 IncrementLimit(test) >03/25/14 13:56:45 IncrementLimit(medium.test) >03/25/14 13:56:45 IncrementLimit(test) >03/25/14 13:56:45 IncrementLimit(medium.test) >03/25/14 13:56:45 IncrementLimit(test) >03/25/14 13:56:45 IncrementLimit(medium.test) >03/25/14 13:56:45 IncrementLimit(undef.test) >03/25/14 13:56:45 IncrementLimit(medium.test) >03/25/14 13:56:45 IncrementLimit(undef) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 IncrementLimit(large.test) >03/25/14 13:56:45 Current Limits -- >03/25/14 13:56:45 Limit: test = 3.000000 >03/25/14 13:56:45 Limit: small.test = 2.000000 >03/25/14 13:56:45 Limit: medium.test = 5.000000 >03/25/14 13:56:45 Limit: undef.test = 1.000000 >03/25/14 13:56:45 Limit: undef = 1.000000 >03/25/14 13:56:45 Limit: large.test = 13.000000 >03/25/14 13:56:45 Limit: medium.undef = 5.000000 >03/25/14 13:56:45 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:56:45 Phase 4.1: Negotiating with schedds ... >03/25/14 13:56:45 numSlots = 30 >03/25/14 13:56:45 slotWeightTotal = 30.000000 >03/25/14 13:56:45 pieLeft = 0.000 >03/25/14 13:56:45 NormalFactor = 1.000000 >03/25/14 13:56:45 MaxPrioValue = 0.580702 >03/25/14 13:56:45 NumSubmitterAds = 1 >03/25/14 13:56:45 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:56:45 0 seconds so far >03/25/14 13:56:45 Calculating submitter limit with the following parameters >03/25/14 13:56:45 SubmitterPrio = 0.580702 >03/25/14 13:56:45 SubmitterPrioFactor = 1.000000 >03/25/14 13:56:45 submitterShare = 1.000000 >03/25/14 13:56:45 submitterAbsShare = 1.000000 >03/25/14 13:56:45 submitterLimit = 0.000000 >03/25/14 13:56:45 submitterUsage = 30.000000 >03/25/14 13:56:45 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:56:45 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00011: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: large.test is 13.000000 >03/25/14 13:56:45 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:56:45 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00025: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:56:45 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:45 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00042: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: small.test is 2.000000 >03/25/14 13:56:45 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:56:45 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00063: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: test is 3.000000 >03/25/14 13:56:45 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:56:45 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00081: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:56:45 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:45 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00101: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: undef is 1.000000 >03/25/14 13:56:45 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:56:45 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:56:45 Request 00001.00125: >03/25/14 13:56:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:56:45 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:56:45 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:56:45 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:56:45 Sending SEND_JOB_INFO/eom >03/25/14 13:56:45 Getting reply from schedd ... >03/25/14 13:56:45 Got NO_MORE_JOBS; done negotiating >03/25/14 13:56:45 This submitter hit its submitterLimit. >03/25/14 13:56:45 resources used scheddUsed= 30.000000 >03/25/14 13:56:45 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:56:45 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:56:45 Getting monitoring info for pid 22893 >03/25/14 13:56:46 Getting monitoring info for pid 22893 >03/25/14 13:56:47 Getting monitoring info for pid 22893 >03/25/14 13:56:48 Getting monitoring info for pid 22893 >03/25/14 13:56:49 Getting monitoring info for pid 22893 >03/25/14 13:56:50 Getting monitoring info for pid 22893 >03/25/14 13:56:51 Getting monitoring info for pid 22893 >03/25/14 13:56:52 Getting monitoring info for pid 22893 >03/25/14 13:56:53 Getting monitoring info for pid 22893 >03/25/14 13:56:54 Getting monitoring info for pid 22893 >03/25/14 13:56:55 Getting monitoring info for pid 22893 >03/25/14 13:56:56 Getting monitoring info for pid 22893 >03/25/14 13:56:57 Getting monitoring info for pid 22893 >03/25/14 13:56:58 Getting monitoring info for pid 22893 >03/25/14 13:56:59 Getting monitoring info for pid 22893 >03/25/14 13:57:00 Getting monitoring info for pid 22893 >03/25/14 13:57:01 Getting monitoring info for pid 22893 >03/25/14 13:57:02 Getting monitoring info for pid 22893 >03/25/14 13:57:03 Getting monitoring info for pid 22893 >03/25/14 13:57:04 Getting monitoring info for pid 22893 >03/25/14 13:57:05 ---------- Started Negotiation Cycle ---------- >03/25/14 13:57:05 Phase 1: Obtaining ads from collector ... >03/25/14 13:57:05 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:57:05 Trying to query collector <IP:9618> >03/25/14 13:57:05 Sorting 32 ads ... >03/25/14 13:57:05 Getting startd private ads ... >03/25/14 13:57:05 Trying to query collector <IP:9618> >03/25/14 13:57:05 Got ads: 32 public and 30 private >03/25/14 13:57:05 Public ads include 1 submitter, 30 startd >03/25/14 13:57:05 Phase 2: Performing accounting ... >03/25/14 13:57:05 Entering compute_significant_attrs() >03/25/14 13:57:05 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:57:05 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:57:05 CustomerName=Customer.<none> , Old Priority=0.581 , New Priority=0.585 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:05 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=10845.000 (unweighted 10845.000), BeginUsageTime=1395751882 >03/25/14 13:57:05 CustomerName=Customer.test@<hostname> , Old Priority=0.581 , New Priority=0.585 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:05 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=10845.000 (unweighted 10845.000), BeginUsageTime=1395751882 >03/25/14 13:57:05 (Accountant) Checking Matches >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:57:05 Match already existed! >03/25/14 13:57:05 Previous Limits -- >03/25/14 13:57:05 Limit: test = 3.000000 >03/25/14 13:57:05 Limit: small.test = 2.000000 >03/25/14 13:57:05 Limit: medium.test = 5.000000 >03/25/14 13:57:05 Limit: undef.test = 1.000000 >03/25/14 13:57:05 Limit: undef = 1.000000 >03/25/14 13:57:05 Limit: large.test = 13.000000 >03/25/14 13:57:05 Limit: medium.undef = 5.000000 >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(medium.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(medium.undef) >03/25/14 13:57:05 IncrementLimit(small.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(medium.undef) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(medium.undef) >03/25/14 13:57:05 IncrementLimit(medium.undef) >03/25/14 13:57:05 IncrementLimit(medium.undef) >03/25/14 13:57:05 IncrementLimit(small.test) >03/25/14 13:57:05 IncrementLimit(test) >03/25/14 13:57:05 IncrementLimit(medium.test) >03/25/14 13:57:05 IncrementLimit(test) >03/25/14 13:57:05 IncrementLimit(medium.test) >03/25/14 13:57:05 IncrementLimit(test) >03/25/14 13:57:05 IncrementLimit(medium.test) >03/25/14 13:57:05 IncrementLimit(undef.test) >03/25/14 13:57:05 IncrementLimit(medium.test) >03/25/14 13:57:05 IncrementLimit(undef) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 IncrementLimit(large.test) >03/25/14 13:57:05 Current Limits -- >03/25/14 13:57:05 Limit: test = 3.000000 >03/25/14 13:57:05 Limit: small.test = 2.000000 >03/25/14 13:57:05 Limit: medium.test = 5.000000 >03/25/14 13:57:05 Limit: undef.test = 1.000000 >03/25/14 13:57:05 Limit: undef = 1.000000 >03/25/14 13:57:05 Limit: large.test = 13.000000 >03/25/14 13:57:05 Limit: medium.undef = 5.000000 >03/25/14 13:57:05 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:57:05 Phase 4.1: Negotiating with schedds ... >03/25/14 13:57:05 numSlots = 30 >03/25/14 13:57:05 slotWeightTotal = 30.000000 >03/25/14 13:57:05 pieLeft = 0.000 >03/25/14 13:57:05 NormalFactor = 1.000000 >03/25/14 13:57:05 MaxPrioValue = 0.585423 >03/25/14 13:57:05 NumSubmitterAds = 1 >03/25/14 13:57:05 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:57:05 0 seconds so far >03/25/14 13:57:05 Calculating submitter limit with the following parameters >03/25/14 13:57:05 SubmitterPrio = 0.585423 >03/25/14 13:57:05 SubmitterPrioFactor = 1.000000 >03/25/14 13:57:05 submitterShare = 1.000000 >03/25/14 13:57:05 submitterAbsShare = 1.000000 >03/25/14 13:57:05 submitterLimit = 0.000000 >03/25/14 13:57:05 submitterUsage = 30.000000 >03/25/14 13:57:05 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:57:05 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00011: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: large.test is 13.000000 >03/25/14 13:57:05 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:57:05 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00025: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:57:05 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:05 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00042: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: small.test is 2.000000 >03/25/14 13:57:05 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:57:05 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00063: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: test is 3.000000 >03/25/14 13:57:05 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:57:05 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00081: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:57:05 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:05 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00101: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: undef is 1.000000 >03/25/14 13:57:05 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:05 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:05 Request 00001.00125: >03/25/14 13:57:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:05 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:57:05 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:05 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:57:05 Sending SEND_JOB_INFO/eom >03/25/14 13:57:05 Getting reply from schedd ... >03/25/14 13:57:05 Got NO_MORE_JOBS; done negotiating >03/25/14 13:57:05 This submitter hit its submitterLimit. >03/25/14 13:57:05 resources used scheddUsed= 30.000000 >03/25/14 13:57:05 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:57:05 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:57:05 Getting monitoring info for pid 22893 >03/25/14 13:57:06 Getting monitoring info for pid 22893 >03/25/14 13:57:07 Getting monitoring info for pid 22893 >03/25/14 13:57:08 Getting monitoring info for pid 22893 >03/25/14 13:57:09 Getting monitoring info for pid 22893 >03/25/14 13:57:10 Getting monitoring info for pid 22893 >03/25/14 13:57:11 Getting monitoring info for pid 22893 >03/25/14 13:57:12 Getting monitoring info for pid 22893 >03/25/14 13:57:13 Getting monitoring info for pid 22893 >03/25/14 13:57:14 Getting monitoring info for pid 22893 >03/25/14 13:57:15 Getting monitoring info for pid 22893 >03/25/14 13:57:16 Getting monitoring info for pid 22893 >03/25/14 13:57:17 Getting monitoring info for pid 22893 >03/25/14 13:57:18 Getting monitoring info for pid 22893 >03/25/14 13:57:19 Getting monitoring info for pid 22893 >03/25/14 13:57:20 Getting monitoring info for pid 22893 >03/25/14 13:57:21 Getting monitoring info for pid 22893 >03/25/14 13:57:22 Getting monitoring info for pid 22893 >03/25/14 13:57:23 Getting monitoring info for pid 22893 >03/25/14 13:57:24 Getting monitoring info for pid 22893 >03/25/14 13:57:25 ---------- Started Negotiation Cycle ---------- >03/25/14 13:57:25 Phase 1: Obtaining ads from collector ... >03/25/14 13:57:25 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:57:25 Trying to query collector <IP:9618> >03/25/14 13:57:25 Sorting 32 ads ... >03/25/14 13:57:25 Getting startd private ads ... >03/25/14 13:57:25 Trying to query collector <IP:9618> >03/25/14 13:57:25 Got ads: 32 public and 30 private >03/25/14 13:57:25 Public ads include 1 submitter, 30 startd >03/25/14 13:57:25 Phase 2: Performing accounting ... >03/25/14 13:57:25 Entering compute_significant_attrs() >03/25/14 13:57:25 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:57:25 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:57:25 CustomerName=Customer.<none> , Old Priority=0.585 , New Priority=0.590 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:25 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=11445.000 (unweighted 11445.000), BeginUsageTime=1395751882 >03/25/14 13:57:25 CustomerName=Customer.test@<hostname> , Old Priority=0.585 , New Priority=0.590 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:25 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=11445.000 (unweighted 11445.000), BeginUsageTime=1395751882 >03/25/14 13:57:25 (Accountant) Checking Matches >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:57:25 Match already existed! >03/25/14 13:57:25 Previous Limits -- >03/25/14 13:57:25 Limit: test = 3.000000 >03/25/14 13:57:25 Limit: small.test = 2.000000 >03/25/14 13:57:25 Limit: medium.test = 5.000000 >03/25/14 13:57:25 Limit: undef.test = 1.000000 >03/25/14 13:57:25 Limit: undef = 1.000000 >03/25/14 13:57:25 Limit: large.test = 13.000000 >03/25/14 13:57:25 Limit: medium.undef = 5.000000 >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(medium.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(medium.undef) >03/25/14 13:57:25 IncrementLimit(small.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(medium.undef) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(medium.undef) >03/25/14 13:57:25 IncrementLimit(medium.undef) >03/25/14 13:57:25 IncrementLimit(medium.undef) >03/25/14 13:57:25 IncrementLimit(small.test) >03/25/14 13:57:25 IncrementLimit(test) >03/25/14 13:57:25 IncrementLimit(medium.test) >03/25/14 13:57:25 IncrementLimit(test) >03/25/14 13:57:25 IncrementLimit(medium.test) >03/25/14 13:57:25 IncrementLimit(test) >03/25/14 13:57:25 IncrementLimit(medium.test) >03/25/14 13:57:25 IncrementLimit(undef.test) >03/25/14 13:57:25 IncrementLimit(medium.test) >03/25/14 13:57:25 IncrementLimit(undef) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 IncrementLimit(large.test) >03/25/14 13:57:25 Current Limits -- >03/25/14 13:57:25 Limit: test = 3.000000 >03/25/14 13:57:25 Limit: small.test = 2.000000 >03/25/14 13:57:25 Limit: medium.test = 5.000000 >03/25/14 13:57:25 Limit: undef.test = 1.000000 >03/25/14 13:57:25 Limit: undef = 1.000000 >03/25/14 13:57:25 Limit: large.test = 13.000000 >03/25/14 13:57:25 Limit: medium.undef = 5.000000 >03/25/14 13:57:25 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:57:25 Phase 4.1: Negotiating with schedds ... >03/25/14 13:57:25 numSlots = 30 >03/25/14 13:57:25 slotWeightTotal = 30.000000 >03/25/14 13:57:25 pieLeft = 0.000 >03/25/14 13:57:25 NormalFactor = 1.000000 >03/25/14 13:57:25 MaxPrioValue = 0.590143 >03/25/14 13:57:25 NumSubmitterAds = 1 >03/25/14 13:57:25 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:57:25 0 seconds so far >03/25/14 13:57:25 Calculating submitter limit with the following parameters >03/25/14 13:57:25 SubmitterPrio = 0.590143 >03/25/14 13:57:25 SubmitterPrioFactor = 1.000000 >03/25/14 13:57:25 submitterShare = 1.000000 >03/25/14 13:57:25 submitterAbsShare = 1.000000 >03/25/14 13:57:25 submitterLimit = 0.000000 >03/25/14 13:57:25 submitterUsage = 30.000000 >03/25/14 13:57:25 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:57:25 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00011: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: large.test is 13.000000 >03/25/14 13:57:25 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:57:25 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00025: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:57:25 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:25 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00042: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: small.test is 2.000000 >03/25/14 13:57:25 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:57:25 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00063: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: test is 3.000000 >03/25/14 13:57:25 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:57:25 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00081: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:57:25 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:25 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00101: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: undef is 1.000000 >03/25/14 13:57:25 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:25 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:25 Request 00001.00125: >03/25/14 13:57:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:25 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:57:25 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:25 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:57:25 Sending SEND_JOB_INFO/eom >03/25/14 13:57:25 Getting reply from schedd ... >03/25/14 13:57:25 Got NO_MORE_JOBS; done negotiating >03/25/14 13:57:25 This submitter hit its submitterLimit. >03/25/14 13:57:25 resources used scheddUsed= 30.000000 >03/25/14 13:57:25 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:57:25 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:57:25 Getting monitoring info for pid 22893 >03/25/14 13:57:26 Getting monitoring info for pid 22893 >03/25/14 13:57:27 Getting monitoring info for pid 22893 >03/25/14 13:57:28 Getting monitoring info for pid 22893 >03/25/14 13:57:29 Getting monitoring info for pid 22893 >03/25/14 13:57:30 Getting monitoring info for pid 22893 >03/25/14 13:57:31 Getting monitoring info for pid 22893 >03/25/14 13:57:32 Getting monitoring info for pid 22893 >03/25/14 13:57:33 Getting monitoring info for pid 22893 >03/25/14 13:57:34 Getting monitoring info for pid 22893 >03/25/14 13:57:35 Getting monitoring info for pid 22893 >03/25/14 13:57:36 Getting monitoring info for pid 22893 >03/25/14 13:57:37 Getting monitoring info for pid 22893 >03/25/14 13:57:38 Getting monitoring info for pid 22893 >03/25/14 13:57:39 Getting monitoring info for pid 22893 >03/25/14 13:57:40 Getting monitoring info for pid 22893 >03/25/14 13:57:41 Getting monitoring info for pid 22893 >03/25/14 13:57:42 Getting monitoring info for pid 22893 >03/25/14 13:57:43 Getting monitoring info for pid 22893 >03/25/14 13:57:44 Getting monitoring info for pid 22893 >03/25/14 13:57:45 ---------- Started Negotiation Cycle ---------- >03/25/14 13:57:45 Phase 1: Obtaining ads from collector ... >03/25/14 13:57:45 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:57:45 Trying to query collector <IP:9618> >03/25/14 13:57:45 Sorting 32 ads ... >03/25/14 13:57:45 Getting startd private ads ... >03/25/14 13:57:45 Trying to query collector <IP:9618> >03/25/14 13:57:45 Got ads: 32 public and 30 private >03/25/14 13:57:45 Public ads include 1 submitter, 30 startd >03/25/14 13:57:45 Phase 2: Performing accounting ... >03/25/14 13:57:45 Entering compute_significant_attrs() >03/25/14 13:57:45 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:57:45 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:57:45 CustomerName=Customer.<none> , Old Priority=0.590 , New Priority=0.595 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:45 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=12045.000 (unweighted 12045.000), BeginUsageTime=1395751882 >03/25/14 13:57:45 CustomerName=Customer.test@<hostname> , Old Priority=0.590 , New Priority=0.595 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:57:45 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=12045.000 (unweighted 12045.000), BeginUsageTime=1395751882 >03/25/14 13:57:45 (Accountant) Checking Matches >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:57:45 Match already existed! >03/25/14 13:57:45 Previous Limits -- >03/25/14 13:57:45 Limit: test = 3.000000 >03/25/14 13:57:45 Limit: small.test = 2.000000 >03/25/14 13:57:45 Limit: medium.test = 5.000000 >03/25/14 13:57:45 Limit: undef.test = 1.000000 >03/25/14 13:57:45 Limit: undef = 1.000000 >03/25/14 13:57:45 Limit: large.test = 13.000000 >03/25/14 13:57:45 Limit: medium.undef = 5.000000 >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(medium.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(medium.undef) >03/25/14 13:57:45 IncrementLimit(small.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(medium.undef) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(medium.undef) >03/25/14 13:57:45 IncrementLimit(medium.undef) >03/25/14 13:57:45 IncrementLimit(medium.undef) >03/25/14 13:57:45 IncrementLimit(small.test) >03/25/14 13:57:45 IncrementLimit(test) >03/25/14 13:57:45 IncrementLimit(medium.test) >03/25/14 13:57:45 IncrementLimit(test) >03/25/14 13:57:45 IncrementLimit(medium.test) >03/25/14 13:57:45 IncrementLimit(test) >03/25/14 13:57:45 IncrementLimit(medium.test) >03/25/14 13:57:45 IncrementLimit(undef.test) >03/25/14 13:57:45 IncrementLimit(medium.test) >03/25/14 13:57:45 IncrementLimit(undef) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 IncrementLimit(large.test) >03/25/14 13:57:45 Current Limits -- >03/25/14 13:57:45 Limit: test = 3.000000 >03/25/14 13:57:45 Limit: small.test = 2.000000 >03/25/14 13:57:45 Limit: medium.test = 5.000000 >03/25/14 13:57:45 Limit: undef.test = 1.000000 >03/25/14 13:57:45 Limit: undef = 1.000000 >03/25/14 13:57:45 Limit: large.test = 13.000000 >03/25/14 13:57:45 Limit: medium.undef = 5.000000 >03/25/14 13:57:45 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:57:45 Phase 4.1: Negotiating with schedds ... >03/25/14 13:57:45 numSlots = 30 >03/25/14 13:57:45 slotWeightTotal = 30.000000 >03/25/14 13:57:45 pieLeft = 0.000 >03/25/14 13:57:45 NormalFactor = 1.000000 >03/25/14 13:57:45 MaxPrioValue = 0.594862 >03/25/14 13:57:45 NumSubmitterAds = 1 >03/25/14 13:57:45 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:57:45 0 seconds so far >03/25/14 13:57:45 Calculating submitter limit with the following parameters >03/25/14 13:57:45 SubmitterPrio = 0.594862 >03/25/14 13:57:45 SubmitterPrioFactor = 1.000000 >03/25/14 13:57:45 submitterShare = 1.000000 >03/25/14 13:57:45 submitterAbsShare = 1.000000 >03/25/14 13:57:45 submitterLimit = 0.000000 >03/25/14 13:57:45 submitterUsage = 30.000000 >03/25/14 13:57:45 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:57:45 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00011: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: large.test is 13.000000 >03/25/14 13:57:45 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:57:45 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00025: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:57:45 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:45 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00042: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: small.test is 2.000000 >03/25/14 13:57:45 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:57:45 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00063: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: test is 3.000000 >03/25/14 13:57:45 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:57:45 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00081: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:57:45 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:45 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00101: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: undef is 1.000000 >03/25/14 13:57:45 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:57:45 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got JOB_INFO command; getting classad/eom >03/25/14 13:57:45 Request 00001.00125: >03/25/14 13:57:45 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:57:45 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:57:45 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:57:45 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:57:45 Sending SEND_JOB_INFO/eom >03/25/14 13:57:45 Getting reply from schedd ... >03/25/14 13:57:45 Got NO_MORE_JOBS; done negotiating >03/25/14 13:57:45 This submitter hit its submitterLimit. >03/25/14 13:57:45 resources used scheddUsed= 30.000000 >03/25/14 13:57:45 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:57:45 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:57:45 Getting monitoring info for pid 22893 >03/25/14 13:57:46 Getting monitoring info for pid 22893 >03/25/14 13:57:47 Getting monitoring info for pid 22893 >03/25/14 13:57:48 Getting monitoring info for pid 22893 >03/25/14 13:57:49 Getting monitoring info for pid 22893 >03/25/14 13:57:50 Getting monitoring info for pid 22893 >03/25/14 13:57:51 Getting monitoring info for pid 22893 >03/25/14 13:57:52 Getting monitoring info for pid 22893 >03/25/14 13:57:53 Getting monitoring info for pid 22893 >03/25/14 13:57:54 Getting monitoring info for pid 22893 >03/25/14 13:57:55 Getting monitoring info for pid 22893 >03/25/14 13:57:56 Getting monitoring info for pid 22893 >03/25/14 13:57:57 Getting monitoring info for pid 22893 >03/25/14 13:57:58 Getting monitoring info for pid 22893 >03/25/14 13:57:59 Getting monitoring info for pid 22893 >03/25/14 13:58:00 Getting monitoring info for pid 22893 >03/25/14 13:58:01 Getting monitoring info for pid 22893 >03/25/14 13:58:01 Getting state information from the accountant >03/25/14 13:58:01 Reporting State >03/25/14 13:58:02 Getting monitoring info for pid 22893 >03/25/14 13:58:03 Getting monitoring info for pid 22893 >03/25/14 13:58:04 Getting monitoring info for pid 22893 >03/25/14 13:58:05 ---------- Started Negotiation Cycle ---------- >03/25/14 13:58:05 Phase 1: Obtaining ads from collector ... >03/25/14 13:58:05 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:58:05 Trying to query collector <IP:9618> >03/25/14 13:58:05 Sorting 32 ads ... >03/25/14 13:58:05 Getting startd private ads ... >03/25/14 13:58:05 Trying to query collector <IP:9618> >03/25/14 13:58:05 Got ads: 32 public and 30 private >03/25/14 13:58:05 Public ads include 1 submitter, 30 startd >03/25/14 13:58:05 Phase 2: Performing accounting ... >03/25/14 13:58:05 Entering compute_significant_attrs() >03/25/14 13:58:05 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:58:05 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:58:05 CustomerName=Customer.<none> , Old Priority=0.595 , New Priority=0.600 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:05 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=12645.000 (unweighted 12645.000), BeginUsageTime=1395751882 >03/25/14 13:58:05 CustomerName=Customer.test@<hostname> , Old Priority=0.595 , New Priority=0.600 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:05 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=12645.000 (unweighted 12645.000), BeginUsageTime=1395751882 >03/25/14 13:58:05 (Accountant) Checking Matches >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:58:05 Match already existed! >03/25/14 13:58:05 Previous Limits -- >03/25/14 13:58:05 Limit: test = 3.000000 >03/25/14 13:58:05 Limit: small.test = 2.000000 >03/25/14 13:58:05 Limit: medium.test = 5.000000 >03/25/14 13:58:05 Limit: undef.test = 1.000000 >03/25/14 13:58:05 Limit: undef = 1.000000 >03/25/14 13:58:05 Limit: large.test = 13.000000 >03/25/14 13:58:05 Limit: medium.undef = 5.000000 >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(medium.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(medium.undef) >03/25/14 13:58:05 IncrementLimit(small.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(medium.undef) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(medium.undef) >03/25/14 13:58:05 IncrementLimit(medium.undef) >03/25/14 13:58:05 IncrementLimit(medium.undef) >03/25/14 13:58:05 IncrementLimit(small.test) >03/25/14 13:58:05 IncrementLimit(test) >03/25/14 13:58:05 IncrementLimit(medium.test) >03/25/14 13:58:05 IncrementLimit(test) >03/25/14 13:58:05 IncrementLimit(medium.test) >03/25/14 13:58:05 IncrementLimit(test) >03/25/14 13:58:05 IncrementLimit(medium.test) >03/25/14 13:58:05 IncrementLimit(undef.test) >03/25/14 13:58:05 IncrementLimit(medium.test) >03/25/14 13:58:05 IncrementLimit(undef) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 IncrementLimit(large.test) >03/25/14 13:58:05 Current Limits -- >03/25/14 13:58:05 Limit: test = 3.000000 >03/25/14 13:58:05 Limit: small.test = 2.000000 >03/25/14 13:58:05 Limit: medium.test = 5.000000 >03/25/14 13:58:05 Limit: undef.test = 1.000000 >03/25/14 13:58:05 Limit: undef = 1.000000 >03/25/14 13:58:05 Limit: large.test = 13.000000 >03/25/14 13:58:05 Limit: medium.undef = 5.000000 >03/25/14 13:58:05 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:58:05 Phase 4.1: Negotiating with schedds ... >03/25/14 13:58:05 numSlots = 30 >03/25/14 13:58:05 slotWeightTotal = 30.000000 >03/25/14 13:58:05 pieLeft = 0.000 >03/25/14 13:58:05 NormalFactor = 1.000000 >03/25/14 13:58:05 MaxPrioValue = 0.599580 >03/25/14 13:58:05 NumSubmitterAds = 1 >03/25/14 13:58:05 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:58:05 0 seconds so far >03/25/14 13:58:05 Calculating submitter limit with the following parameters >03/25/14 13:58:05 SubmitterPrio = 0.599580 >03/25/14 13:58:05 SubmitterPrioFactor = 1.000000 >03/25/14 13:58:05 submitterShare = 1.000000 >03/25/14 13:58:05 submitterAbsShare = 1.000000 >03/25/14 13:58:05 submitterLimit = 0.000000 >03/25/14 13:58:05 submitterUsage = 30.000000 >03/25/14 13:58:05 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:58:05 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00011: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: large.test is 13.000000 >03/25/14 13:58:05 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:58:05 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00025: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:58:05 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:05 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00042: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: small.test is 2.000000 >03/25/14 13:58:05 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:58:05 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00063: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: test is 3.000000 >03/25/14 13:58:05 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:58:05 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00081: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:58:05 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:05 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00101: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: undef is 1.000000 >03/25/14 13:58:05 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:05 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:05 Request 00001.00125: >03/25/14 13:58:05 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:05 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:58:05 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:05 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:58:05 Sending SEND_JOB_INFO/eom >03/25/14 13:58:05 Getting reply from schedd ... >03/25/14 13:58:05 Got NO_MORE_JOBS; done negotiating >03/25/14 13:58:05 This submitter hit its submitterLimit. >03/25/14 13:58:05 resources used scheddUsed= 30.000000 >03/25/14 13:58:05 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:58:05 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:58:05 Getting monitoring info for pid 22893 >03/25/14 13:58:06 Getting monitoring info for pid 22893 >03/25/14 13:58:07 Getting monitoring info for pid 22893 >03/25/14 13:58:08 Getting monitoring info for pid 22893 >03/25/14 13:58:09 Getting monitoring info for pid 22893 >03/25/14 13:58:10 Getting monitoring info for pid 22893 >03/25/14 13:58:11 Getting monitoring info for pid 22893 >03/25/14 13:58:12 Getting monitoring info for pid 22893 >03/25/14 13:58:13 Getting monitoring info for pid 22893 >03/25/14 13:58:14 Getting monitoring info for pid 22893 >03/25/14 13:58:15 Getting monitoring info for pid 22893 >03/25/14 13:58:16 Getting monitoring info for pid 22893 >03/25/14 13:58:17 Getting monitoring info for pid 22893 >03/25/14 13:58:18 Getting monitoring info for pid 22893 >03/25/14 13:58:19 Getting monitoring info for pid 22893 >03/25/14 13:58:20 Getting monitoring info for pid 22893 >03/25/14 13:58:21 Getting monitoring info for pid 22893 >03/25/14 13:58:22 Getting monitoring info for pid 22893 >03/25/14 13:58:23 Getting monitoring info for pid 22893 >03/25/14 13:58:24 Getting monitoring info for pid 22893 >03/25/14 13:58:25 ---------- Started Negotiation Cycle ---------- >03/25/14 13:58:25 Phase 1: Obtaining ads from collector ... >03/25/14 13:58:25 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:58:25 Trying to query collector <IP:9618> >03/25/14 13:58:25 Sorting 32 ads ... >03/25/14 13:58:25 Getting startd private ads ... >03/25/14 13:58:25 Trying to query collector <IP:9618> >03/25/14 13:58:25 Got ads: 32 public and 30 private >03/25/14 13:58:25 Public ads include 1 submitter, 30 startd >03/25/14 13:58:25 Phase 2: Performing accounting ... >03/25/14 13:58:25 Entering compute_significant_attrs() >03/25/14 13:58:25 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:58:25 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:58:25 CustomerName=Customer.<none> , Old Priority=0.600 , New Priority=0.604 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:25 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=13245.000 (unweighted 13245.000), BeginUsageTime=1395751882 >03/25/14 13:58:25 CustomerName=Customer.test@<hostname> , Old Priority=0.600 , New Priority=0.604 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:25 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=13245.000 (unweighted 13245.000), BeginUsageTime=1395751882 >03/25/14 13:58:25 (Accountant) Checking Matches >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:58:25 Match already existed! >03/25/14 13:58:25 Previous Limits -- >03/25/14 13:58:25 Limit: test = 3.000000 >03/25/14 13:58:25 Limit: small.test = 2.000000 >03/25/14 13:58:25 Limit: medium.test = 5.000000 >03/25/14 13:58:25 Limit: undef.test = 1.000000 >03/25/14 13:58:25 Limit: undef = 1.000000 >03/25/14 13:58:25 Limit: large.test = 13.000000 >03/25/14 13:58:25 Limit: medium.undef = 5.000000 >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(medium.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(medium.undef) >03/25/14 13:58:25 IncrementLimit(small.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(medium.undef) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(medium.undef) >03/25/14 13:58:25 IncrementLimit(medium.undef) >03/25/14 13:58:25 IncrementLimit(medium.undef) >03/25/14 13:58:25 IncrementLimit(small.test) >03/25/14 13:58:25 IncrementLimit(test) >03/25/14 13:58:25 IncrementLimit(medium.test) >03/25/14 13:58:25 IncrementLimit(test) >03/25/14 13:58:25 IncrementLimit(medium.test) >03/25/14 13:58:25 IncrementLimit(test) >03/25/14 13:58:25 IncrementLimit(medium.test) >03/25/14 13:58:25 IncrementLimit(undef.test) >03/25/14 13:58:25 IncrementLimit(medium.test) >03/25/14 13:58:25 IncrementLimit(undef) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 IncrementLimit(large.test) >03/25/14 13:58:25 Current Limits -- >03/25/14 13:58:25 Limit: test = 3.000000 >03/25/14 13:58:25 Limit: small.test = 2.000000 >03/25/14 13:58:25 Limit: medium.test = 5.000000 >03/25/14 13:58:25 Limit: undef.test = 1.000000 >03/25/14 13:58:25 Limit: undef = 1.000000 >03/25/14 13:58:25 Limit: large.test = 13.000000 >03/25/14 13:58:25 Limit: medium.undef = 5.000000 >03/25/14 13:58:25 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:58:25 Phase 4.1: Negotiating with schedds ... >03/25/14 13:58:25 numSlots = 30 >03/25/14 13:58:25 slotWeightTotal = 30.000000 >03/25/14 13:58:25 pieLeft = 0.000 >03/25/14 13:58:25 NormalFactor = 1.000000 >03/25/14 13:58:25 MaxPrioValue = 0.604297 >03/25/14 13:58:25 NumSubmitterAds = 1 >03/25/14 13:58:25 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:58:25 0 seconds so far >03/25/14 13:58:25 Calculating submitter limit with the following parameters >03/25/14 13:58:25 SubmitterPrio = 0.604297 >03/25/14 13:58:25 SubmitterPrioFactor = 1.000000 >03/25/14 13:58:25 submitterShare = 1.000000 >03/25/14 13:58:25 submitterAbsShare = 1.000000 >03/25/14 13:58:25 submitterLimit = 0.000000 >03/25/14 13:58:25 submitterUsage = 30.000000 >03/25/14 13:58:25 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:58:25 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00011: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: large.test is 13.000000 >03/25/14 13:58:25 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:58:25 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00025: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:58:25 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:25 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00042: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: small.test is 2.000000 >03/25/14 13:58:25 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:58:25 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00063: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: test is 3.000000 >03/25/14 13:58:25 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:58:25 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00081: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:58:25 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:25 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00101: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: undef is 1.000000 >03/25/14 13:58:25 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:25 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:25 Request 00001.00125: >03/25/14 13:58:25 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:25 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:58:25 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:25 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:58:25 Sending SEND_JOB_INFO/eom >03/25/14 13:58:25 Getting reply from schedd ... >03/25/14 13:58:25 Got NO_MORE_JOBS; done negotiating >03/25/14 13:58:25 This submitter hit its submitterLimit. >03/25/14 13:58:25 resources used scheddUsed= 30.000000 >03/25/14 13:58:25 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:58:25 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:58:25 Getting monitoring info for pid 22893 >03/25/14 13:58:26 Getting monitoring info for pid 22893 >03/25/14 13:58:27 Getting monitoring info for pid 22893 >03/25/14 13:58:28 Getting monitoring info for pid 22893 >03/25/14 13:58:29 Getting monitoring info for pid 22893 >03/25/14 13:58:30 Getting monitoring info for pid 22893 >03/25/14 13:58:31 Getting monitoring info for pid 22893 >03/25/14 13:58:32 Getting monitoring info for pid 22893 >03/25/14 13:58:33 Getting monitoring info for pid 22893 >03/25/14 13:58:34 Getting monitoring info for pid 22893 >03/25/14 13:58:35 Getting monitoring info for pid 22893 >03/25/14 13:58:36 Getting monitoring info for pid 22893 >03/25/14 13:58:37 Getting monitoring info for pid 22893 >03/25/14 13:58:38 Getting monitoring info for pid 22893 >03/25/14 13:58:39 Getting monitoring info for pid 22893 >03/25/14 13:58:40 Getting monitoring info for pid 22893 >03/25/14 13:58:41 Getting monitoring info for pid 22893 >03/25/14 13:58:42 Getting monitoring info for pid 22893 >03/25/14 13:58:43 Getting monitoring info for pid 22893 >03/25/14 13:58:44 Getting monitoring info for pid 22893 >03/25/14 13:58:45 ---------- Started Negotiation Cycle ---------- >03/25/14 13:58:45 Phase 1: Obtaining ads from collector ... >03/25/14 13:58:45 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:58:45 Trying to query collector <IP:9618> >03/25/14 13:58:45 Sorting 32 ads ... >03/25/14 13:58:45 Getting startd private ads ... >03/25/14 13:58:45 Trying to query collector <IP:9618> >03/25/14 13:58:46 Got ads: 32 public and 30 private >03/25/14 13:58:46 Public ads include 1 submitter, 30 startd >03/25/14 13:58:46 Phase 2: Performing accounting ... >03/25/14 13:58:46 Entering compute_significant_attrs() >03/25/14 13:58:46 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:58:46 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 13:58:46 CustomerName=Customer.<none> , Old Priority=0.604 , New Priority=0.609 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:46 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=13875.000 (unweighted 13875.000), BeginUsageTime=1395751882 >03/25/14 13:58:46 CustomerName=Customer.test@<hostname> , Old Priority=0.604 , New Priority=0.609 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:58:46 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=13875.000 (unweighted 13875.000), BeginUsageTime=1395751882 >03/25/14 13:58:46 (Accountant) Checking Matches >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:58:46 Match already existed! >03/25/14 13:58:46 Previous Limits -- >03/25/14 13:58:46 Limit: test = 3.000000 >03/25/14 13:58:46 Limit: small.test = 2.000000 >03/25/14 13:58:46 Limit: medium.test = 5.000000 >03/25/14 13:58:46 Limit: undef.test = 1.000000 >03/25/14 13:58:46 Limit: undef = 1.000000 >03/25/14 13:58:46 Limit: large.test = 13.000000 >03/25/14 13:58:46 Limit: medium.undef = 5.000000 >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(medium.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(medium.undef) >03/25/14 13:58:46 IncrementLimit(small.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(medium.undef) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(medium.undef) >03/25/14 13:58:46 IncrementLimit(medium.undef) >03/25/14 13:58:46 IncrementLimit(medium.undef) >03/25/14 13:58:46 IncrementLimit(small.test) >03/25/14 13:58:46 IncrementLimit(test) >03/25/14 13:58:46 IncrementLimit(medium.test) >03/25/14 13:58:46 IncrementLimit(test) >03/25/14 13:58:46 IncrementLimit(medium.test) >03/25/14 13:58:46 IncrementLimit(test) >03/25/14 13:58:46 IncrementLimit(medium.test) >03/25/14 13:58:46 IncrementLimit(undef.test) >03/25/14 13:58:46 IncrementLimit(medium.test) >03/25/14 13:58:46 IncrementLimit(undef) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 IncrementLimit(large.test) >03/25/14 13:58:46 Current Limits -- >03/25/14 13:58:46 Limit: test = 3.000000 >03/25/14 13:58:46 Limit: small.test = 2.000000 >03/25/14 13:58:46 Limit: medium.test = 5.000000 >03/25/14 13:58:46 Limit: undef.test = 1.000000 >03/25/14 13:58:46 Limit: undef = 1.000000 >03/25/14 13:58:46 Limit: large.test = 13.000000 >03/25/14 13:58:46 Limit: medium.undef = 5.000000 >03/25/14 13:58:46 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:58:46 Phase 4.1: Negotiating with schedds ... >03/25/14 13:58:46 numSlots = 30 >03/25/14 13:58:46 slotWeightTotal = 30.000000 >03/25/14 13:58:46 pieLeft = 0.000 >03/25/14 13:58:46 NormalFactor = 1.000000 >03/25/14 13:58:46 MaxPrioValue = 0.609248 >03/25/14 13:58:46 NumSubmitterAds = 1 >03/25/14 13:58:46 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:58:46 0 seconds so far >03/25/14 13:58:46 Calculating submitter limit with the following parameters >03/25/14 13:58:46 SubmitterPrio = 0.609248 >03/25/14 13:58:46 SubmitterPrioFactor = 1.000000 >03/25/14 13:58:46 submitterShare = 1.000000 >03/25/14 13:58:46 submitterAbsShare = 1.000000 >03/25/14 13:58:46 submitterLimit = 0.000000 >03/25/14 13:58:46 submitterUsage = 30.000000 >03/25/14 13:58:46 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:58:46 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00011: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: large.test is 13.000000 >03/25/14 13:58:46 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:58:46 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00025: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:58:46 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:46 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00042: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: small.test is 2.000000 >03/25/14 13:58:46 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:58:46 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00063: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: test is 3.000000 >03/25/14 13:58:46 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:58:46 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00081: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:58:46 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:46 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00101: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: undef is 1.000000 >03/25/14 13:58:46 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:58:46 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:58:46 Request 00001.00125: >03/25/14 13:58:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:58:46 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:58:46 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:58:46 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:58:46 Sending SEND_JOB_INFO/eom >03/25/14 13:58:46 Getting reply from schedd ... >03/25/14 13:58:46 Got NO_MORE_JOBS; done negotiating >03/25/14 13:58:46 This submitter hit its submitterLimit. >03/25/14 13:58:46 resources used scheddUsed= 30.000000 >03/25/14 13:58:46 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:58:46 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:58:46 Getting monitoring info for pid 22893 >03/25/14 13:58:47 Getting monitoring info for pid 22893 >03/25/14 13:58:48 Getting monitoring info for pid 22893 >03/25/14 13:58:49 Getting monitoring info for pid 22893 >03/25/14 13:58:50 Getting monitoring info for pid 22893 >03/25/14 13:58:51 Getting monitoring info for pid 22893 >03/25/14 13:58:52 Getting monitoring info for pid 22893 >03/25/14 13:58:53 Getting monitoring info for pid 22893 >03/25/14 13:58:54 Getting monitoring info for pid 22893 >03/25/14 13:58:55 Getting monitoring info for pid 22893 >03/25/14 13:58:56 Getting monitoring info for pid 22893 >03/25/14 13:58:57 Getting monitoring info for pid 22893 >03/25/14 13:58:58 Getting monitoring info for pid 22893 >03/25/14 13:58:59 Getting monitoring info for pid 22893 >03/25/14 13:59:00 Getting monitoring info for pid 22893 >03/25/14 13:59:01 Getting monitoring info for pid 22893 >03/25/14 13:59:02 Getting monitoring info for pid 22893 >03/25/14 13:59:03 Getting monitoring info for pid 22893 >03/25/14 13:59:04 Getting monitoring info for pid 22893 >03/25/14 13:59:05 Getting monitoring info for pid 22893 >03/25/14 13:59:06 ---------- Started Negotiation Cycle ---------- >03/25/14 13:59:06 Phase 1: Obtaining ads from collector ... >03/25/14 13:59:06 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:59:06 Trying to query collector <IP:9618> >03/25/14 13:59:06 Sorting 32 ads ... >03/25/14 13:59:06 Getting startd private ads ... >03/25/14 13:59:06 Trying to query collector <IP:9618> >03/25/14 13:59:06 Got ads: 32 public and 30 private >03/25/14 13:59:06 Public ads include 1 submitter, 30 startd >03/25/14 13:59:06 Phase 2: Performing accounting ... >03/25/14 13:59:06 Entering compute_significant_attrs() >03/25/14 13:59:06 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:59:06 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:59:06 CustomerName=Customer.<none> , Old Priority=0.609 , New Priority=0.614 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:06 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=14475.000 (unweighted 14475.000), BeginUsageTime=1395751882 >03/25/14 13:59:06 CustomerName=Customer.test@<hostname> , Old Priority=0.609 , New Priority=0.614 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:06 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=14475.000 (unweighted 14475.000), BeginUsageTime=1395751882 >03/25/14 13:59:06 (Accountant) Checking Matches >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:59:06 Match already existed! >03/25/14 13:59:06 Previous Limits -- >03/25/14 13:59:06 Limit: test = 3.000000 >03/25/14 13:59:06 Limit: small.test = 2.000000 >03/25/14 13:59:06 Limit: medium.test = 5.000000 >03/25/14 13:59:06 Limit: undef.test = 1.000000 >03/25/14 13:59:06 Limit: undef = 1.000000 >03/25/14 13:59:06 Limit: large.test = 13.000000 >03/25/14 13:59:06 Limit: medium.undef = 5.000000 >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(medium.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(medium.undef) >03/25/14 13:59:06 IncrementLimit(small.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(medium.undef) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(medium.undef) >03/25/14 13:59:06 IncrementLimit(medium.undef) >03/25/14 13:59:06 IncrementLimit(medium.undef) >03/25/14 13:59:06 IncrementLimit(small.test) >03/25/14 13:59:06 IncrementLimit(test) >03/25/14 13:59:06 IncrementLimit(medium.test) >03/25/14 13:59:06 IncrementLimit(test) >03/25/14 13:59:06 IncrementLimit(medium.test) >03/25/14 13:59:06 IncrementLimit(test) >03/25/14 13:59:06 IncrementLimit(medium.test) >03/25/14 13:59:06 IncrementLimit(undef.test) >03/25/14 13:59:06 IncrementLimit(medium.test) >03/25/14 13:59:06 IncrementLimit(undef) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 IncrementLimit(large.test) >03/25/14 13:59:06 Current Limits -- >03/25/14 13:59:06 Limit: test = 3.000000 >03/25/14 13:59:06 Limit: small.test = 2.000000 >03/25/14 13:59:06 Limit: medium.test = 5.000000 >03/25/14 13:59:06 Limit: undef.test = 1.000000 >03/25/14 13:59:06 Limit: undef = 1.000000 >03/25/14 13:59:06 Limit: large.test = 13.000000 >03/25/14 13:59:06 Limit: medium.undef = 5.000000 >03/25/14 13:59:06 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:59:06 Phase 4.1: Negotiating with schedds ... >03/25/14 13:59:06 numSlots = 30 >03/25/14 13:59:06 slotWeightTotal = 30.000000 >03/25/14 13:59:06 pieLeft = 0.000 >03/25/14 13:59:06 NormalFactor = 1.000000 >03/25/14 13:59:06 MaxPrioValue = 0.613964 >03/25/14 13:59:06 NumSubmitterAds = 1 >03/25/14 13:59:06 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:59:06 0 seconds so far >03/25/14 13:59:06 Calculating submitter limit with the following parameters >03/25/14 13:59:06 SubmitterPrio = 0.613964 >03/25/14 13:59:06 SubmitterPrioFactor = 1.000000 >03/25/14 13:59:06 submitterShare = 1.000000 >03/25/14 13:59:06 submitterAbsShare = 1.000000 >03/25/14 13:59:06 submitterLimit = 0.000000 >03/25/14 13:59:06 submitterUsage = 30.000000 >03/25/14 13:59:06 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:59:06 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00011: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: large.test is 13.000000 >03/25/14 13:59:06 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:59:06 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00025: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:59:06 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:06 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00042: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: small.test is 2.000000 >03/25/14 13:59:06 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:59:06 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00063: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: test is 3.000000 >03/25/14 13:59:06 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:59:06 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00081: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:59:06 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:06 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00101: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: undef is 1.000000 >03/25/14 13:59:06 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:06 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:06 Request 00001.00125: >03/25/14 13:59:06 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:06 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:59:06 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:06 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:59:06 Sending SEND_JOB_INFO/eom >03/25/14 13:59:06 Getting reply from schedd ... >03/25/14 13:59:06 Got NO_MORE_JOBS; done negotiating >03/25/14 13:59:06 This submitter hit its submitterLimit. >03/25/14 13:59:06 resources used scheddUsed= 30.000000 >03/25/14 13:59:06 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:59:06 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:59:06 Getting monitoring info for pid 22893 >03/25/14 13:59:07 Getting monitoring info for pid 22893 >03/25/14 13:59:08 Getting monitoring info for pid 22893 >03/25/14 13:59:09 Getting monitoring info for pid 22893 >03/25/14 13:59:10 Getting monitoring info for pid 22893 >03/25/14 13:59:11 Getting monitoring info for pid 22893 >03/25/14 13:59:12 Getting monitoring info for pid 22893 >03/25/14 13:59:13 Getting monitoring info for pid 22893 >03/25/14 13:59:14 Getting monitoring info for pid 22893 >03/25/14 13:59:15 Getting monitoring info for pid 22893 >03/25/14 13:59:16 Getting monitoring info for pid 22893 >03/25/14 13:59:17 Getting monitoring info for pid 22893 >03/25/14 13:59:18 Getting monitoring info for pid 22893 >03/25/14 13:59:19 Getting monitoring info for pid 22893 >03/25/14 13:59:20 Getting monitoring info for pid 22893 >03/25/14 13:59:21 Getting monitoring info for pid 22893 >03/25/14 13:59:22 Getting monitoring info for pid 22893 >03/25/14 13:59:23 Getting monitoring info for pid 22893 >03/25/14 13:59:24 Getting monitoring info for pid 22893 >03/25/14 13:59:25 Getting monitoring info for pid 22893 >03/25/14 13:59:26 ---------- Started Negotiation Cycle ---------- >03/25/14 13:59:26 Phase 1: Obtaining ads from collector ... >03/25/14 13:59:26 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:59:26 Trying to query collector <IP:9618> >03/25/14 13:59:26 Sorting 32 ads ... >03/25/14 13:59:26 Getting startd private ads ... >03/25/14 13:59:26 Trying to query collector <IP:9618> >03/25/14 13:59:26 Got ads: 32 public and 30 private >03/25/14 13:59:26 Public ads include 1 submitter, 30 startd >03/25/14 13:59:26 Phase 2: Performing accounting ... >03/25/14 13:59:26 Entering compute_significant_attrs() >03/25/14 13:59:26 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:59:26 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:59:26 CustomerName=Customer.<none> , Old Priority=0.614 , New Priority=0.619 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:26 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=15075.000 (unweighted 15075.000), BeginUsageTime=1395751882 >03/25/14 13:59:26 CustomerName=Customer.test@<hostname> , Old Priority=0.614 , New Priority=0.619 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:26 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=15075.000 (unweighted 15075.000), BeginUsageTime=1395751882 >03/25/14 13:59:26 (Accountant) Checking Matches >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:59:26 Match already existed! >03/25/14 13:59:26 Previous Limits -- >03/25/14 13:59:26 Limit: test = 3.000000 >03/25/14 13:59:26 Limit: small.test = 2.000000 >03/25/14 13:59:26 Limit: medium.test = 5.000000 >03/25/14 13:59:26 Limit: undef.test = 1.000000 >03/25/14 13:59:26 Limit: undef = 1.000000 >03/25/14 13:59:26 Limit: large.test = 13.000000 >03/25/14 13:59:26 Limit: medium.undef = 5.000000 >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(medium.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(medium.undef) >03/25/14 13:59:26 IncrementLimit(small.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(medium.undef) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(medium.undef) >03/25/14 13:59:26 IncrementLimit(medium.undef) >03/25/14 13:59:26 IncrementLimit(medium.undef) >03/25/14 13:59:26 IncrementLimit(small.test) >03/25/14 13:59:26 IncrementLimit(test) >03/25/14 13:59:26 IncrementLimit(medium.test) >03/25/14 13:59:26 IncrementLimit(test) >03/25/14 13:59:26 IncrementLimit(medium.test) >03/25/14 13:59:26 IncrementLimit(test) >03/25/14 13:59:26 IncrementLimit(medium.test) >03/25/14 13:59:26 IncrementLimit(undef.test) >03/25/14 13:59:26 IncrementLimit(medium.test) >03/25/14 13:59:26 IncrementLimit(undef) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 IncrementLimit(large.test) >03/25/14 13:59:26 Current Limits -- >03/25/14 13:59:26 Limit: test = 3.000000 >03/25/14 13:59:26 Limit: small.test = 2.000000 >03/25/14 13:59:26 Limit: medium.test = 5.000000 >03/25/14 13:59:26 Limit: undef.test = 1.000000 >03/25/14 13:59:26 Limit: undef = 1.000000 >03/25/14 13:59:26 Limit: large.test = 13.000000 >03/25/14 13:59:26 Limit: medium.undef = 5.000000 >03/25/14 13:59:26 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:59:26 Phase 4.1: Negotiating with schedds ... >03/25/14 13:59:26 numSlots = 30 >03/25/14 13:59:26 slotWeightTotal = 30.000000 >03/25/14 13:59:26 pieLeft = 0.000 >03/25/14 13:59:26 NormalFactor = 1.000000 >03/25/14 13:59:26 MaxPrioValue = 0.618679 >03/25/14 13:59:26 NumSubmitterAds = 1 >03/25/14 13:59:26 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:59:26 0 seconds so far >03/25/14 13:59:26 Calculating submitter limit with the following parameters >03/25/14 13:59:26 SubmitterPrio = 0.618679 >03/25/14 13:59:26 SubmitterPrioFactor = 1.000000 >03/25/14 13:59:26 submitterShare = 1.000000 >03/25/14 13:59:26 submitterAbsShare = 1.000000 >03/25/14 13:59:26 submitterLimit = 0.000000 >03/25/14 13:59:26 submitterUsage = 30.000000 >03/25/14 13:59:26 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:59:26 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00011: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: large.test is 13.000000 >03/25/14 13:59:26 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:59:26 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00025: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:59:26 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:26 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00042: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: small.test is 2.000000 >03/25/14 13:59:26 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:59:26 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00063: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: test is 3.000000 >03/25/14 13:59:26 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:59:26 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00081: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:59:26 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:26 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00101: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: undef is 1.000000 >03/25/14 13:59:26 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:26 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:26 Request 00001.00125: >03/25/14 13:59:26 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:26 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:59:26 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:26 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:59:26 Sending SEND_JOB_INFO/eom >03/25/14 13:59:26 Getting reply from schedd ... >03/25/14 13:59:26 Got NO_MORE_JOBS; done negotiating >03/25/14 13:59:26 This submitter hit its submitterLimit. >03/25/14 13:59:26 resources used scheddUsed= 30.000000 >03/25/14 13:59:26 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:59:26 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:59:26 Getting monitoring info for pid 22893 >03/25/14 13:59:27 Getting monitoring info for pid 22893 >03/25/14 13:59:28 Getting monitoring info for pid 22893 >03/25/14 13:59:29 Getting monitoring info for pid 22893 >03/25/14 13:59:30 Getting monitoring info for pid 22893 >03/25/14 13:59:31 Getting monitoring info for pid 22893 >03/25/14 13:59:32 Getting monitoring info for pid 22893 >03/25/14 13:59:33 Getting monitoring info for pid 22893 >03/25/14 13:59:34 Getting monitoring info for pid 22893 >03/25/14 13:59:35 Getting monitoring info for pid 22893 >03/25/14 13:59:36 Getting monitoring info for pid 22893 >03/25/14 13:59:37 Getting monitoring info for pid 22893 >03/25/14 13:59:38 Getting monitoring info for pid 22893 >03/25/14 13:59:39 Getting monitoring info for pid 22893 >03/25/14 13:59:40 Getting monitoring info for pid 22893 >03/25/14 13:59:41 Getting monitoring info for pid 22893 >03/25/14 13:59:42 Getting monitoring info for pid 22893 >03/25/14 13:59:43 Getting monitoring info for pid 22893 >03/25/14 13:59:44 Getting monitoring info for pid 22893 >03/25/14 13:59:45 Getting monitoring info for pid 22893 >03/25/14 13:59:46 ---------- Started Negotiation Cycle ---------- >03/25/14 13:59:46 Phase 1: Obtaining ads from collector ... >03/25/14 13:59:46 Getting Scheduler, Submitter and Machine ads ... >03/25/14 13:59:46 Trying to query collector <IP:9618> >03/25/14 13:59:46 Sorting 32 ads ... >03/25/14 13:59:46 Getting startd private ads ... >03/25/14 13:59:46 Trying to query collector <IP:9618> >03/25/14 13:59:46 Got ads: 32 public and 30 private >03/25/14 13:59:46 Public ads include 1 submitter, 30 startd >03/25/14 13:59:46 Phase 2: Performing accounting ... >03/25/14 13:59:46 Entering compute_significant_attrs() >03/25/14 13:59:46 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 13:59:46 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 13:59:46 CustomerName=Customer.<none> , Old Priority=0.619 , New Priority=0.623 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:46 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=15675.000 (unweighted 15675.000), BeginUsageTime=1395751882 >03/25/14 13:59:46 CustomerName=Customer.test@<hostname> , Old Priority=0.619 , New Priority=0.623 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 13:59:46 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=15675.000 (unweighted 15675.000), BeginUsageTime=1395751882 >03/25/14 13:59:46 (Accountant) Checking Matches >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 13:59:46 Match already existed! >03/25/14 13:59:46 Previous Limits -- >03/25/14 13:59:46 Limit: test = 3.000000 >03/25/14 13:59:46 Limit: small.test = 2.000000 >03/25/14 13:59:46 Limit: medium.test = 5.000000 >03/25/14 13:59:46 Limit: undef.test = 1.000000 >03/25/14 13:59:46 Limit: undef = 1.000000 >03/25/14 13:59:46 Limit: large.test = 13.000000 >03/25/14 13:59:46 Limit: medium.undef = 5.000000 >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(medium.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(medium.undef) >03/25/14 13:59:46 IncrementLimit(small.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(medium.undef) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(medium.undef) >03/25/14 13:59:46 IncrementLimit(medium.undef) >03/25/14 13:59:46 IncrementLimit(medium.undef) >03/25/14 13:59:46 IncrementLimit(small.test) >03/25/14 13:59:46 IncrementLimit(test) >03/25/14 13:59:46 IncrementLimit(medium.test) >03/25/14 13:59:46 IncrementLimit(test) >03/25/14 13:59:46 IncrementLimit(medium.test) >03/25/14 13:59:46 IncrementLimit(test) >03/25/14 13:59:46 IncrementLimit(medium.test) >03/25/14 13:59:46 IncrementLimit(undef.test) >03/25/14 13:59:46 IncrementLimit(medium.test) >03/25/14 13:59:46 IncrementLimit(undef) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 IncrementLimit(large.test) >03/25/14 13:59:46 Current Limits -- >03/25/14 13:59:46 Limit: test = 3.000000 >03/25/14 13:59:46 Limit: small.test = 2.000000 >03/25/14 13:59:46 Limit: medium.test = 5.000000 >03/25/14 13:59:46 Limit: undef.test = 1.000000 >03/25/14 13:59:46 Limit: undef = 1.000000 >03/25/14 13:59:46 Limit: large.test = 13.000000 >03/25/14 13:59:46 Limit: medium.undef = 5.000000 >03/25/14 13:59:46 Phase 3: Sorting submitter ads by priority ... >03/25/14 13:59:46 Phase 4.1: Negotiating with schedds ... >03/25/14 13:59:46 numSlots = 30 >03/25/14 13:59:46 slotWeightTotal = 30.000000 >03/25/14 13:59:46 pieLeft = 0.000 >03/25/14 13:59:46 NormalFactor = 1.000000 >03/25/14 13:59:46 MaxPrioValue = 0.623393 >03/25/14 13:59:46 NumSubmitterAds = 1 >03/25/14 13:59:46 Negotiating with test@<hostname> at <IP:43885> >03/25/14 13:59:46 0 seconds so far >03/25/14 13:59:46 Calculating submitter limit with the following parameters >03/25/14 13:59:46 SubmitterPrio = 0.623393 >03/25/14 13:59:46 SubmitterPrioFactor = 1.000000 >03/25/14 13:59:46 submitterShare = 1.000000 >03/25/14 13:59:46 submitterAbsShare = 1.000000 >03/25/14 13:59:46 submitterLimit = 0.000000 >03/25/14 13:59:46 submitterUsage = 30.000000 >03/25/14 13:59:46 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 13:59:46 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00011: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: large.test is 13.000000 >03/25/14 13:59:46 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 13:59:46 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00025: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: medium.test is 5.000000 >03/25/14 13:59:46 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:46 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00042: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: small.test is 2.000000 >03/25/14 13:59:46 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 13:59:46 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00063: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: test is 3.000000 >03/25/14 13:59:46 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 13:59:46 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00081: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: undef.test is 1.000000 >03/25/14 13:59:46 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:46 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00101: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: undef is 1.000000 >03/25/14 13:59:46 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 13:59:46 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got JOB_INFO command; getting classad/eom >03/25/14 13:59:46 Request 00001.00125: >03/25/14 13:59:46 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 13:59:46 Concurrency Limit: medium.undef is 5.000000 >03/25/14 13:59:46 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 13:59:46 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 13:59:46 Sending SEND_JOB_INFO/eom >03/25/14 13:59:46 Getting reply from schedd ... >03/25/14 13:59:46 Got NO_MORE_JOBS; done negotiating >03/25/14 13:59:46 This submitter hit its submitterLimit. >03/25/14 13:59:46 resources used scheddUsed= 30.000000 >03/25/14 13:59:46 negotiateWithGroup resources used scheddAds length 1 >03/25/14 13:59:46 ---------- Finished Negotiation Cycle ---------- >03/25/14 13:59:46 Getting monitoring info for pid 22893 >03/25/14 13:59:47 Getting monitoring info for pid 22893 >03/25/14 13:59:48 Getting monitoring info for pid 22893 >03/25/14 13:59:49 Getting monitoring info for pid 22893 >03/25/14 13:59:50 Getting monitoring info for pid 22893 >03/25/14 13:59:51 Getting monitoring info for pid 22893 >03/25/14 13:59:52 Getting monitoring info for pid 22893 >03/25/14 13:59:53 Getting monitoring info for pid 22893 >03/25/14 13:59:54 Getting monitoring info for pid 22893 >03/25/14 13:59:55 Getting monitoring info for pid 22893 >03/25/14 13:59:56 Getting monitoring info for pid 22893 >03/25/14 13:59:57 Getting monitoring info for pid 22893 >03/25/14 13:59:58 Getting monitoring info for pid 22893 >03/25/14 13:59:59 Getting monitoring info for pid 22893 >03/25/14 14:00:00 Getting monitoring info for pid 22893 >03/25/14 14:00:01 Getting monitoring info for pid 22893 >03/25/14 14:00:02 Getting monitoring info for pid 22893 >03/25/14 14:00:03 Getting monitoring info for pid 22893 >03/25/14 14:00:04 Getting monitoring info for pid 22893 >03/25/14 14:00:05 Getting monitoring info for pid 22893 >03/25/14 14:00:06 ---------- Started Negotiation Cycle ---------- >03/25/14 14:00:06 Phase 1: Obtaining ads from collector ... >03/25/14 14:00:06 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:00:06 Trying to query collector <IP:9618> >03/25/14 14:00:07 Sorting 32 ads ... >03/25/14 14:00:07 Getting startd private ads ... >03/25/14 14:00:07 Trying to query collector <IP:9618> >03/25/14 14:00:07 Got ads: 32 public and 30 private >03/25/14 14:00:07 Public ads include 1 submitter, 30 startd >03/25/14 14:00:07 Phase 2: Performing accounting ... >03/25/14 14:00:07 Entering compute_significant_attrs() >03/25/14 14:00:07 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:00:07 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:00:07 CustomerName=Customer.<none> , Old Priority=0.623 , New Priority=0.628 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:07 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=16305.000 (unweighted 16305.000), BeginUsageTime=1395751882 >03/25/14 14:00:07 CustomerName=Customer.test@<hostname> , Old Priority=0.623 , New Priority=0.628 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:07 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=16305.000 (unweighted 16305.000), BeginUsageTime=1395751882 >03/25/14 14:00:07 (Accountant) Checking Matches >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:00:07 Match already existed! >03/25/14 14:00:07 Previous Limits -- >03/25/14 14:00:07 Limit: test = 3.000000 >03/25/14 14:00:07 Limit: small.test = 2.000000 >03/25/14 14:00:07 Limit: medium.test = 5.000000 >03/25/14 14:00:07 Limit: undef.test = 1.000000 >03/25/14 14:00:07 Limit: undef = 1.000000 >03/25/14 14:00:07 Limit: large.test = 13.000000 >03/25/14 14:00:07 Limit: medium.undef = 5.000000 >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(medium.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(medium.undef) >03/25/14 14:00:07 IncrementLimit(small.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(medium.undef) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(medium.undef) >03/25/14 14:00:07 IncrementLimit(medium.undef) >03/25/14 14:00:07 IncrementLimit(medium.undef) >03/25/14 14:00:07 IncrementLimit(small.test) >03/25/14 14:00:07 IncrementLimit(test) >03/25/14 14:00:07 IncrementLimit(medium.test) >03/25/14 14:00:07 IncrementLimit(test) >03/25/14 14:00:07 IncrementLimit(medium.test) >03/25/14 14:00:07 IncrementLimit(test) >03/25/14 14:00:07 IncrementLimit(medium.test) >03/25/14 14:00:07 IncrementLimit(undef.test) >03/25/14 14:00:07 IncrementLimit(medium.test) >03/25/14 14:00:07 IncrementLimit(undef) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 IncrementLimit(large.test) >03/25/14 14:00:07 Current Limits -- >03/25/14 14:00:07 Limit: test = 3.000000 >03/25/14 14:00:07 Limit: small.test = 2.000000 >03/25/14 14:00:07 Limit: medium.test = 5.000000 >03/25/14 14:00:07 Limit: undef.test = 1.000000 >03/25/14 14:00:07 Limit: undef = 1.000000 >03/25/14 14:00:07 Limit: large.test = 13.000000 >03/25/14 14:00:07 Limit: medium.undef = 5.000000 >03/25/14 14:00:07 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:00:07 Phase 4.1: Negotiating with schedds ... >03/25/14 14:00:07 numSlots = 30 >03/25/14 14:00:07 slotWeightTotal = 30.000000 >03/25/14 14:00:07 pieLeft = 0.000 >03/25/14 14:00:07 NormalFactor = 1.000000 >03/25/14 14:00:07 MaxPrioValue = 0.628341 >03/25/14 14:00:07 NumSubmitterAds = 1 >03/25/14 14:00:07 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:00:07 0 seconds so far >03/25/14 14:00:07 Calculating submitter limit with the following parameters >03/25/14 14:00:07 SubmitterPrio = 0.628341 >03/25/14 14:00:07 SubmitterPrioFactor = 1.000000 >03/25/14 14:00:07 submitterShare = 1.000000 >03/25/14 14:00:07 submitterAbsShare = 1.000000 >03/25/14 14:00:07 submitterLimit = 0.000000 >03/25/14 14:00:07 submitterUsage = 30.000000 >03/25/14 14:00:07 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:00:07 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00011: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: large.test is 13.000000 >03/25/14 14:00:07 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:00:07 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00025: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:00:07 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:07 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00042: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: small.test is 2.000000 >03/25/14 14:00:07 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:00:07 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00063: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: test is 3.000000 >03/25/14 14:00:07 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:00:07 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00081: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:00:07 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:07 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00101: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: undef is 1.000000 >03/25/14 14:00:07 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:07 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:07 Request 00001.00125: >03/25/14 14:00:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:07 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:00:07 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:07 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:00:07 Sending SEND_JOB_INFO/eom >03/25/14 14:00:07 Getting reply from schedd ... >03/25/14 14:00:07 Got NO_MORE_JOBS; done negotiating >03/25/14 14:00:07 This submitter hit its submitterLimit. >03/25/14 14:00:07 resources used scheddUsed= 30.000000 >03/25/14 14:00:07 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:00:07 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:00:07 Getting monitoring info for pid 22893 >03/25/14 14:00:08 Getting monitoring info for pid 22893 >03/25/14 14:00:09 Getting monitoring info for pid 22893 >03/25/14 14:00:10 Getting monitoring info for pid 22893 >03/25/14 14:00:11 Getting monitoring info for pid 22893 >03/25/14 14:00:12 Getting monitoring info for pid 22893 >03/25/14 14:00:13 Getting monitoring info for pid 22893 >03/25/14 14:00:14 Getting monitoring info for pid 22893 >03/25/14 14:00:15 Getting monitoring info for pid 22893 >03/25/14 14:00:16 Getting monitoring info for pid 22893 >03/25/14 14:00:17 Getting monitoring info for pid 22893 >03/25/14 14:00:18 Getting monitoring info for pid 22893 >03/25/14 14:00:19 Getting monitoring info for pid 22893 >03/25/14 14:00:20 Getting monitoring info for pid 22893 >03/25/14 14:00:21 Getting monitoring info for pid 22893 >03/25/14 14:00:22 Getting monitoring info for pid 22893 >03/25/14 14:00:23 Getting monitoring info for pid 22893 >03/25/14 14:00:24 Getting monitoring info for pid 22893 >03/25/14 14:00:25 Getting monitoring info for pid 22893 >03/25/14 14:00:26 Getting monitoring info for pid 22893 >03/25/14 14:00:27 ---------- Started Negotiation Cycle ---------- >03/25/14 14:00:27 Phase 1: Obtaining ads from collector ... >03/25/14 14:00:27 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:00:27 Trying to query collector <IP:9618> >03/25/14 14:00:27 Sorting 32 ads ... >03/25/14 14:00:27 Getting startd private ads ... >03/25/14 14:00:27 Trying to query collector <IP:9618> >03/25/14 14:00:27 Got ads: 32 public and 30 private >03/25/14 14:00:27 Public ads include 1 submitter, 30 startd >03/25/14 14:00:27 Phase 2: Performing accounting ... >03/25/14 14:00:27 Entering compute_significant_attrs() >03/25/14 14:00:27 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:00:27 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:00:27 CustomerName=Customer.<none> , Old Priority=0.628 , New Priority=0.633 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:27 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=16905.000 (unweighted 16905.000), BeginUsageTime=1395751882 >03/25/14 14:00:27 CustomerName=Customer.test@<hostname> , Old Priority=0.628 , New Priority=0.633 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:27 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=16905.000 (unweighted 16905.000), BeginUsageTime=1395751882 >03/25/14 14:00:27 (Accountant) Checking Matches >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:00:27 Match already existed! >03/25/14 14:00:27 Previous Limits -- >03/25/14 14:00:27 Limit: test = 3.000000 >03/25/14 14:00:27 Limit: small.test = 2.000000 >03/25/14 14:00:27 Limit: medium.test = 5.000000 >03/25/14 14:00:27 Limit: undef.test = 1.000000 >03/25/14 14:00:27 Limit: undef = 1.000000 >03/25/14 14:00:27 Limit: large.test = 13.000000 >03/25/14 14:00:27 Limit: medium.undef = 5.000000 >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(medium.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(medium.undef) >03/25/14 14:00:27 IncrementLimit(small.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(medium.undef) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(medium.undef) >03/25/14 14:00:27 IncrementLimit(medium.undef) >03/25/14 14:00:27 IncrementLimit(medium.undef) >03/25/14 14:00:27 IncrementLimit(small.test) >03/25/14 14:00:27 IncrementLimit(test) >03/25/14 14:00:27 IncrementLimit(medium.test) >03/25/14 14:00:27 IncrementLimit(test) >03/25/14 14:00:27 IncrementLimit(medium.test) >03/25/14 14:00:27 IncrementLimit(test) >03/25/14 14:00:27 IncrementLimit(medium.test) >03/25/14 14:00:27 IncrementLimit(undef.test) >03/25/14 14:00:27 IncrementLimit(medium.test) >03/25/14 14:00:27 IncrementLimit(undef) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 IncrementLimit(large.test) >03/25/14 14:00:27 Current Limits -- >03/25/14 14:00:27 Limit: test = 3.000000 >03/25/14 14:00:27 Limit: small.test = 2.000000 >03/25/14 14:00:27 Limit: medium.test = 5.000000 >03/25/14 14:00:27 Limit: undef.test = 1.000000 >03/25/14 14:00:27 Limit: undef = 1.000000 >03/25/14 14:00:27 Limit: large.test = 13.000000 >03/25/14 14:00:27 Limit: medium.undef = 5.000000 >03/25/14 14:00:27 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:00:27 Phase 4.1: Negotiating with schedds ... >03/25/14 14:00:27 numSlots = 30 >03/25/14 14:00:27 slotWeightTotal = 30.000000 >03/25/14 14:00:27 pieLeft = 0.000 >03/25/14 14:00:27 NormalFactor = 1.000000 >03/25/14 14:00:27 MaxPrioValue = 0.633054 >03/25/14 14:00:27 NumSubmitterAds = 1 >03/25/14 14:00:27 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:00:27 0 seconds so far >03/25/14 14:00:27 Calculating submitter limit with the following parameters >03/25/14 14:00:27 SubmitterPrio = 0.633054 >03/25/14 14:00:27 SubmitterPrioFactor = 1.000000 >03/25/14 14:00:27 submitterShare = 1.000000 >03/25/14 14:00:27 submitterAbsShare = 1.000000 >03/25/14 14:00:27 submitterLimit = 0.000000 >03/25/14 14:00:27 submitterUsage = 30.000000 >03/25/14 14:00:27 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:00:27 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00011: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: large.test is 13.000000 >03/25/14 14:00:27 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:00:27 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00025: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:00:27 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:27 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00042: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: small.test is 2.000000 >03/25/14 14:00:27 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:00:27 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00063: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: test is 3.000000 >03/25/14 14:00:27 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:00:27 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00081: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:00:27 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:27 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00101: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: undef is 1.000000 >03/25/14 14:00:27 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:27 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:27 Request 00001.00125: >03/25/14 14:00:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:27 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:00:27 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:27 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:00:27 Sending SEND_JOB_INFO/eom >03/25/14 14:00:27 Getting reply from schedd ... >03/25/14 14:00:27 Got NO_MORE_JOBS; done negotiating >03/25/14 14:00:27 This submitter hit its submitterLimit. >03/25/14 14:00:27 resources used scheddUsed= 30.000000 >03/25/14 14:00:27 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:00:27 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:00:27 Getting monitoring info for pid 22893 >03/25/14 14:00:28 Getting monitoring info for pid 22893 >03/25/14 14:00:29 Getting monitoring info for pid 22893 >03/25/14 14:00:30 enter Matchmaker::updateCollector >03/25/14 14:00:30 Warning: Could not find DaemonStartTime >03/25/14 14:00:30 Trying to update collector <IP:9618> >03/25/14 14:00:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:00:30 exit Matchmaker::UpdateCollector >03/25/14 14:00:30 Getting monitoring info for pid 22893 >03/25/14 14:00:31 Getting monitoring info for pid 22893 >03/25/14 14:00:32 Getting monitoring info for pid 22893 >03/25/14 14:00:33 Getting monitoring info for pid 22893 >03/25/14 14:00:34 Getting monitoring info for pid 22893 >03/25/14 14:00:35 Getting monitoring info for pid 22893 >03/25/14 14:00:36 Getting monitoring info for pid 22893 >03/25/14 14:00:37 Getting monitoring info for pid 22893 >03/25/14 14:00:38 Getting monitoring info for pid 22893 >03/25/14 14:00:39 Getting monitoring info for pid 22893 >03/25/14 14:00:40 Getting monitoring info for pid 22893 >03/25/14 14:00:41 Getting monitoring info for pid 22893 >03/25/14 14:00:42 Getting monitoring info for pid 22893 >03/25/14 14:00:43 Getting monitoring info for pid 22893 >03/25/14 14:00:44 Getting monitoring info for pid 22893 >03/25/14 14:00:45 Getting monitoring info for pid 22893 >03/25/14 14:00:46 Getting monitoring info for pid 22893 >03/25/14 14:00:47 ---------- Started Negotiation Cycle ---------- >03/25/14 14:00:47 Phase 1: Obtaining ads from collector ... >03/25/14 14:00:47 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:00:47 Trying to query collector <IP:9618> >03/25/14 14:00:47 Sorting 32 ads ... >03/25/14 14:00:47 Getting startd private ads ... >03/25/14 14:00:47 Trying to query collector <IP:9618> >03/25/14 14:00:47 Got ads: 32 public and 30 private >03/25/14 14:00:47 Public ads include 1 submitter, 30 startd >03/25/14 14:00:47 Phase 2: Performing accounting ... >03/25/14 14:00:47 Entering compute_significant_attrs() >03/25/14 14:00:47 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:00:47 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:00:47 CustomerName=Customer.<none> , Old Priority=0.633 , New Priority=0.638 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:47 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=17505.000 (unweighted 17505.000), BeginUsageTime=1395751882 >03/25/14 14:00:47 CustomerName=Customer.test@<hostname> , Old Priority=0.633 , New Priority=0.638 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:00:47 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=17505.000 (unweighted 17505.000), BeginUsageTime=1395751882 >03/25/14 14:00:47 (Accountant) Checking Matches >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:00:47 Match already existed! >03/25/14 14:00:47 Previous Limits -- >03/25/14 14:00:47 Limit: test = 3.000000 >03/25/14 14:00:47 Limit: small.test = 2.000000 >03/25/14 14:00:47 Limit: medium.test = 5.000000 >03/25/14 14:00:47 Limit: undef.test = 1.000000 >03/25/14 14:00:47 Limit: undef = 1.000000 >03/25/14 14:00:47 Limit: large.test = 13.000000 >03/25/14 14:00:47 Limit: medium.undef = 5.000000 >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(medium.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(medium.undef) >03/25/14 14:00:47 IncrementLimit(small.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(medium.undef) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(medium.undef) >03/25/14 14:00:47 IncrementLimit(medium.undef) >03/25/14 14:00:47 IncrementLimit(small.test) >03/25/14 14:00:47 IncrementLimit(medium.undef) >03/25/14 14:00:47 IncrementLimit(test) >03/25/14 14:00:47 IncrementLimit(medium.test) >03/25/14 14:00:47 IncrementLimit(test) >03/25/14 14:00:47 IncrementLimit(medium.test) >03/25/14 14:00:47 IncrementLimit(test) >03/25/14 14:00:47 IncrementLimit(medium.test) >03/25/14 14:00:47 IncrementLimit(undef.test) >03/25/14 14:00:47 IncrementLimit(medium.test) >03/25/14 14:00:47 IncrementLimit(undef) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 IncrementLimit(large.test) >03/25/14 14:00:47 Current Limits -- >03/25/14 14:00:47 Limit: test = 3.000000 >03/25/14 14:00:47 Limit: small.test = 2.000000 >03/25/14 14:00:47 Limit: medium.test = 5.000000 >03/25/14 14:00:47 Limit: undef.test = 1.000000 >03/25/14 14:00:47 Limit: undef = 1.000000 >03/25/14 14:00:47 Limit: large.test = 13.000000 >03/25/14 14:00:47 Limit: medium.undef = 5.000000 >03/25/14 14:00:47 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:00:47 Phase 4.1: Negotiating with schedds ... >03/25/14 14:00:47 numSlots = 30 >03/25/14 14:00:47 slotWeightTotal = 30.000000 >03/25/14 14:00:47 pieLeft = 0.000 >03/25/14 14:00:47 NormalFactor = 1.000000 >03/25/14 14:00:47 MaxPrioValue = 0.637766 >03/25/14 14:00:47 NumSubmitterAds = 1 >03/25/14 14:00:47 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:00:47 0 seconds so far >03/25/14 14:00:47 Calculating submitter limit with the following parameters >03/25/14 14:00:47 SubmitterPrio = 0.637766 >03/25/14 14:00:47 SubmitterPrioFactor = 1.000000 >03/25/14 14:00:47 submitterShare = 1.000000 >03/25/14 14:00:47 submitterAbsShare = 1.000000 >03/25/14 14:00:47 submitterLimit = 0.000000 >03/25/14 14:00:47 submitterUsage = 30.000000 >03/25/14 14:00:47 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:00:47 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00011: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: large.test is 13.000000 >03/25/14 14:00:47 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:00:47 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00025: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:00:47 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:47 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00042: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: small.test is 2.000000 >03/25/14 14:00:47 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:00:47 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00063: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: test is 3.000000 >03/25/14 14:00:47 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:00:47 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00081: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:00:47 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:47 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00101: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: undef is 1.000000 >03/25/14 14:00:47 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:00:47 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:00:47 Request 00001.00125: >03/25/14 14:00:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:00:47 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:00:47 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:00:47 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:00:47 Sending SEND_JOB_INFO/eom >03/25/14 14:00:47 Getting reply from schedd ... >03/25/14 14:00:47 Got NO_MORE_JOBS; done negotiating >03/25/14 14:00:47 This submitter hit its submitterLimit. >03/25/14 14:00:47 resources used scheddUsed= 30.000000 >03/25/14 14:00:47 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:00:47 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:00:47 Getting monitoring info for pid 22893 >03/25/14 14:00:48 Getting monitoring info for pid 22893 >03/25/14 14:00:49 Getting monitoring info for pid 22893 >03/25/14 14:00:50 Getting monitoring info for pid 22893 >03/25/14 14:00:51 Getting monitoring info for pid 22893 >03/25/14 14:00:52 Getting monitoring info for pid 22893 >03/25/14 14:00:54 Getting monitoring info for pid 22893 >03/25/14 14:00:55 Getting monitoring info for pid 22893 >03/25/14 14:00:56 Getting monitoring info for pid 22893 >03/25/14 14:00:57 Getting monitoring info for pid 22893 >03/25/14 14:00:58 Getting monitoring info for pid 22893 >03/25/14 14:00:59 Getting monitoring info for pid 22893 >03/25/14 14:01:00 Getting monitoring info for pid 22893 >03/25/14 14:01:01 Getting monitoring info for pid 22893 >03/25/14 14:01:02 Getting monitoring info for pid 22893 >03/25/14 14:01:03 Getting monitoring info for pid 22893 >03/25/14 14:01:04 Getting monitoring info for pid 22893 >03/25/14 14:01:05 Getting monitoring info for pid 22893 >03/25/14 14:01:06 Getting monitoring info for pid 22893 >03/25/14 14:01:07 ---------- Started Negotiation Cycle ---------- >03/25/14 14:01:07 Phase 1: Obtaining ads from collector ... >03/25/14 14:01:07 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:01:07 Trying to query collector <IP:9618> >03/25/14 14:01:07 Sorting 32 ads ... >03/25/14 14:01:07 Getting startd private ads ... >03/25/14 14:01:07 Trying to query collector <IP:9618> >03/25/14 14:01:07 Got ads: 32 public and 30 private >03/25/14 14:01:07 Public ads include 1 submitter, 30 startd >03/25/14 14:01:07 Phase 2: Performing accounting ... >03/25/14 14:01:07 Entering compute_significant_attrs() >03/25/14 14:01:07 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:01:07 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:01:07 CustomerName=Customer.<none> , Old Priority=0.638 , New Priority=0.642 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:07 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=18105.000 (unweighted 18105.000), BeginUsageTime=1395751882 >03/25/14 14:01:07 CustomerName=Customer.test@<hostname> , Old Priority=0.638 , New Priority=0.642 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:07 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=18105.000 (unweighted 18105.000), BeginUsageTime=1395751882 >03/25/14 14:01:07 (Accountant) Checking Matches >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:01:07 Match already existed! >03/25/14 14:01:07 Previous Limits -- >03/25/14 14:01:07 Limit: test = 3.000000 >03/25/14 14:01:07 Limit: small.test = 2.000000 >03/25/14 14:01:07 Limit: medium.test = 5.000000 >03/25/14 14:01:07 Limit: undef.test = 1.000000 >03/25/14 14:01:07 Limit: undef = 1.000000 >03/25/14 14:01:07 Limit: large.test = 13.000000 >03/25/14 14:01:07 Limit: medium.undef = 5.000000 >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(medium.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(medium.undef) >03/25/14 14:01:07 IncrementLimit(small.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(medium.undef) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(medium.undef) >03/25/14 14:01:07 IncrementLimit(medium.undef) >03/25/14 14:01:07 IncrementLimit(medium.undef) >03/25/14 14:01:07 IncrementLimit(small.test) >03/25/14 14:01:07 IncrementLimit(test) >03/25/14 14:01:07 IncrementLimit(medium.test) >03/25/14 14:01:07 IncrementLimit(test) >03/25/14 14:01:07 IncrementLimit(medium.test) >03/25/14 14:01:07 IncrementLimit(test) >03/25/14 14:01:07 IncrementLimit(medium.test) >03/25/14 14:01:07 IncrementLimit(undef.test) >03/25/14 14:01:07 IncrementLimit(medium.test) >03/25/14 14:01:07 IncrementLimit(undef) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 IncrementLimit(large.test) >03/25/14 14:01:07 Current Limits -- >03/25/14 14:01:07 Limit: test = 3.000000 >03/25/14 14:01:07 Limit: small.test = 2.000000 >03/25/14 14:01:07 Limit: medium.test = 5.000000 >03/25/14 14:01:07 Limit: undef.test = 1.000000 >03/25/14 14:01:07 Limit: undef = 1.000000 >03/25/14 14:01:07 Limit: large.test = 13.000000 >03/25/14 14:01:07 Limit: medium.undef = 5.000000 >03/25/14 14:01:07 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:01:07 Phase 4.1: Negotiating with schedds ... >03/25/14 14:01:07 numSlots = 30 >03/25/14 14:01:07 slotWeightTotal = 30.000000 >03/25/14 14:01:07 pieLeft = 0.000 >03/25/14 14:01:07 NormalFactor = 1.000000 >03/25/14 14:01:07 MaxPrioValue = 0.642477 >03/25/14 14:01:07 NumSubmitterAds = 1 >03/25/14 14:01:07 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:01:07 0 seconds so far >03/25/14 14:01:07 Calculating submitter limit with the following parameters >03/25/14 14:01:07 SubmitterPrio = 0.642477 >03/25/14 14:01:07 SubmitterPrioFactor = 1.000000 >03/25/14 14:01:07 submitterShare = 1.000000 >03/25/14 14:01:07 submitterAbsShare = 1.000000 >03/25/14 14:01:07 submitterLimit = 0.000000 >03/25/14 14:01:07 submitterUsage = 30.000000 >03/25/14 14:01:07 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:01:07 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00011: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: large.test is 13.000000 >03/25/14 14:01:07 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:01:07 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00025: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:01:07 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:07 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00042: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: small.test is 2.000000 >03/25/14 14:01:07 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:01:07 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00063: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: test is 3.000000 >03/25/14 14:01:07 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:01:07 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00081: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:01:07 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:07 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00101: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: undef is 1.000000 >03/25/14 14:01:07 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:07 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:07 Request 00001.00125: >03/25/14 14:01:07 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:07 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:01:07 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:07 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:01:07 Sending SEND_JOB_INFO/eom >03/25/14 14:01:07 Getting reply from schedd ... >03/25/14 14:01:07 Got NO_MORE_JOBS; done negotiating >03/25/14 14:01:07 This submitter hit its submitterLimit. >03/25/14 14:01:07 resources used scheddUsed= 30.000000 >03/25/14 14:01:07 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:01:07 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:01:07 Getting monitoring info for pid 22893 >03/25/14 14:01:08 Getting monitoring info for pid 22893 >03/25/14 14:01:09 Getting monitoring info for pid 22893 >03/25/14 14:01:10 Getting monitoring info for pid 22893 >03/25/14 14:01:11 Getting monitoring info for pid 22893 >03/25/14 14:01:12 Getting monitoring info for pid 22893 >03/25/14 14:01:13 Getting monitoring info for pid 22893 >03/25/14 14:01:14 Getting monitoring info for pid 22893 >03/25/14 14:01:15 Getting monitoring info for pid 22893 >03/25/14 14:01:16 Getting monitoring info for pid 22893 >03/25/14 14:01:17 Getting monitoring info for pid 22893 >03/25/14 14:01:18 Getting monitoring info for pid 22893 >03/25/14 14:01:19 Getting monitoring info for pid 22893 >03/25/14 14:01:20 Getting monitoring info for pid 22893 >03/25/14 14:01:21 Getting monitoring info for pid 22893 >03/25/14 14:01:22 Getting monitoring info for pid 22893 >03/25/14 14:01:23 Getting monitoring info for pid 22893 >03/25/14 14:01:24 Getting monitoring info for pid 22893 >03/25/14 14:01:25 Getting monitoring info for pid 22893 >03/25/14 14:01:26 Getting monitoring info for pid 22893 >03/25/14 14:01:27 ---------- Started Negotiation Cycle ---------- >03/25/14 14:01:27 Phase 1: Obtaining ads from collector ... >03/25/14 14:01:27 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:01:27 Trying to query collector <IP:9618> >03/25/14 14:01:27 Sorting 32 ads ... >03/25/14 14:01:27 Getting startd private ads ... >03/25/14 14:01:27 Trying to query collector <IP:9618> >03/25/14 14:01:27 Got ads: 32 public and 30 private >03/25/14 14:01:27 Public ads include 1 submitter, 30 startd >03/25/14 14:01:27 Phase 2: Performing accounting ... >03/25/14 14:01:27 Entering compute_significant_attrs() >03/25/14 14:01:27 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:01:27 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:01:27 CustomerName=Customer.<none> , Old Priority=0.642 , New Priority=0.647 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:27 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=18705.000 (unweighted 18705.000), BeginUsageTime=1395751882 >03/25/14 14:01:27 CustomerName=Customer.test@<hostname> , Old Priority=0.642 , New Priority=0.647 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:27 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=18705.000 (unweighted 18705.000), BeginUsageTime=1395751882 >03/25/14 14:01:27 (Accountant) Checking Matches >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:01:27 Match already existed! >03/25/14 14:01:27 Previous Limits -- >03/25/14 14:01:27 Limit: test = 3.000000 >03/25/14 14:01:27 Limit: small.test = 2.000000 >03/25/14 14:01:27 Limit: medium.test = 5.000000 >03/25/14 14:01:27 Limit: undef.test = 1.000000 >03/25/14 14:01:27 Limit: undef = 1.000000 >03/25/14 14:01:27 Limit: large.test = 13.000000 >03/25/14 14:01:27 Limit: medium.undef = 5.000000 >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(medium.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(medium.undef) >03/25/14 14:01:27 IncrementLimit(small.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(medium.undef) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(medium.undef) >03/25/14 14:01:27 IncrementLimit(medium.undef) >03/25/14 14:01:27 IncrementLimit(medium.undef) >03/25/14 14:01:27 IncrementLimit(small.test) >03/25/14 14:01:27 IncrementLimit(test) >03/25/14 14:01:27 IncrementLimit(medium.test) >03/25/14 14:01:27 IncrementLimit(test) >03/25/14 14:01:27 IncrementLimit(medium.test) >03/25/14 14:01:27 IncrementLimit(test) >03/25/14 14:01:27 IncrementLimit(medium.test) >03/25/14 14:01:27 IncrementLimit(undef.test) >03/25/14 14:01:27 IncrementLimit(medium.test) >03/25/14 14:01:27 IncrementLimit(undef) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 IncrementLimit(large.test) >03/25/14 14:01:27 Current Limits -- >03/25/14 14:01:27 Limit: test = 3.000000 >03/25/14 14:01:27 Limit: small.test = 2.000000 >03/25/14 14:01:27 Limit: medium.test = 5.000000 >03/25/14 14:01:27 Limit: undef.test = 1.000000 >03/25/14 14:01:27 Limit: undef = 1.000000 >03/25/14 14:01:27 Limit: large.test = 13.000000 >03/25/14 14:01:27 Limit: medium.undef = 5.000000 >03/25/14 14:01:27 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:01:27 Phase 4.1: Negotiating with schedds ... >03/25/14 14:01:27 numSlots = 30 >03/25/14 14:01:27 slotWeightTotal = 30.000000 >03/25/14 14:01:27 pieLeft = 0.000 >03/25/14 14:01:27 NormalFactor = 1.000000 >03/25/14 14:01:27 MaxPrioValue = 0.647188 >03/25/14 14:01:27 NumSubmitterAds = 1 >03/25/14 14:01:27 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:01:27 0 seconds so far >03/25/14 14:01:27 Calculating submitter limit with the following parameters >03/25/14 14:01:27 SubmitterPrio = 0.647188 >03/25/14 14:01:27 SubmitterPrioFactor = 1.000000 >03/25/14 14:01:27 submitterShare = 1.000000 >03/25/14 14:01:27 submitterAbsShare = 1.000000 >03/25/14 14:01:27 submitterLimit = 0.000000 >03/25/14 14:01:27 submitterUsage = 30.000000 >03/25/14 14:01:27 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:01:27 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00011: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: large.test is 13.000000 >03/25/14 14:01:27 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:01:27 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00025: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:01:27 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:27 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00042: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: small.test is 2.000000 >03/25/14 14:01:27 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:01:27 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00063: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: test is 3.000000 >03/25/14 14:01:27 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:01:27 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00081: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:01:27 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:27 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00101: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: undef is 1.000000 >03/25/14 14:01:27 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:27 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:27 Request 00001.00125: >03/25/14 14:01:27 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:27 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:01:27 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:27 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:01:27 Sending SEND_JOB_INFO/eom >03/25/14 14:01:27 Getting reply from schedd ... >03/25/14 14:01:27 Got NO_MORE_JOBS; done negotiating >03/25/14 14:01:27 This submitter hit its submitterLimit. >03/25/14 14:01:27 resources used scheddUsed= 30.000000 >03/25/14 14:01:27 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:01:27 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:01:27 Getting monitoring info for pid 22893 >03/25/14 14:01:28 Getting monitoring info for pid 22893 >03/25/14 14:01:29 Getting monitoring info for pid 22893 >03/25/14 14:01:30 Getting monitoring info for pid 22893 >03/25/14 14:01:31 Getting monitoring info for pid 22893 >03/25/14 14:01:32 Getting monitoring info for pid 22893 >03/25/14 14:01:33 Getting monitoring info for pid 22893 >03/25/14 14:01:34 Getting monitoring info for pid 22893 >03/25/14 14:01:35 Getting monitoring info for pid 22893 >03/25/14 14:01:36 Getting monitoring info for pid 22893 >03/25/14 14:01:37 Getting monitoring info for pid 22893 >03/25/14 14:01:38 Getting monitoring info for pid 22893 >03/25/14 14:01:39 Getting monitoring info for pid 22893 >03/25/14 14:01:40 Getting monitoring info for pid 22893 >03/25/14 14:01:41 Getting monitoring info for pid 22893 >03/25/14 14:01:42 Getting monitoring info for pid 22893 >03/25/14 14:01:43 Getting monitoring info for pid 22893 >03/25/14 14:01:44 Getting monitoring info for pid 22893 >03/25/14 14:01:45 Getting monitoring info for pid 22893 >03/25/14 14:01:46 Getting monitoring info for pid 22893 >03/25/14 14:01:47 ---------- Started Negotiation Cycle ---------- >03/25/14 14:01:47 Phase 1: Obtaining ads from collector ... >03/25/14 14:01:47 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:01:47 Trying to query collector <IP:9618> >03/25/14 14:01:47 Sorting 32 ads ... >03/25/14 14:01:47 Getting startd private ads ... >03/25/14 14:01:47 Trying to query collector <IP:9618> >03/25/14 14:01:47 Got ads: 32 public and 30 private >03/25/14 14:01:47 Public ads include 1 submitter, 30 startd >03/25/14 14:01:47 Phase 2: Performing accounting ... >03/25/14 14:01:47 Entering compute_significant_attrs() >03/25/14 14:01:47 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:01:47 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:01:47 CustomerName=Customer.<none> , Old Priority=0.647 , New Priority=0.652 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:47 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=19305.000 (unweighted 19305.000), BeginUsageTime=1395751882 >03/25/14 14:01:47 CustomerName=Customer.test@<hostname> , Old Priority=0.647 , New Priority=0.652 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:01:47 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=19305.000 (unweighted 19305.000), BeginUsageTime=1395751882 >03/25/14 14:01:47 (Accountant) Checking Matches >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:01:47 Match already existed! >03/25/14 14:01:47 Previous Limits -- >03/25/14 14:01:47 Limit: test = 3.000000 >03/25/14 14:01:47 Limit: small.test = 2.000000 >03/25/14 14:01:47 Limit: medium.test = 5.000000 >03/25/14 14:01:47 Limit: undef.test = 1.000000 >03/25/14 14:01:47 Limit: undef = 1.000000 >03/25/14 14:01:47 Limit: large.test = 13.000000 >03/25/14 14:01:47 Limit: medium.undef = 5.000000 >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(medium.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(medium.undef) >03/25/14 14:01:47 IncrementLimit(small.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(medium.undef) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(medium.undef) >03/25/14 14:01:47 IncrementLimit(medium.undef) >03/25/14 14:01:47 IncrementLimit(medium.undef) >03/25/14 14:01:47 IncrementLimit(small.test) >03/25/14 14:01:47 IncrementLimit(test) >03/25/14 14:01:47 IncrementLimit(medium.test) >03/25/14 14:01:47 IncrementLimit(test) >03/25/14 14:01:47 IncrementLimit(medium.test) >03/25/14 14:01:47 IncrementLimit(test) >03/25/14 14:01:47 IncrementLimit(medium.test) >03/25/14 14:01:47 IncrementLimit(undef.test) >03/25/14 14:01:47 IncrementLimit(medium.test) >03/25/14 14:01:47 IncrementLimit(undef) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 IncrementLimit(large.test) >03/25/14 14:01:47 Current Limits -- >03/25/14 14:01:47 Limit: test = 3.000000 >03/25/14 14:01:47 Limit: small.test = 2.000000 >03/25/14 14:01:47 Limit: medium.test = 5.000000 >03/25/14 14:01:47 Limit: undef.test = 1.000000 >03/25/14 14:01:47 Limit: undef = 1.000000 >03/25/14 14:01:47 Limit: large.test = 13.000000 >03/25/14 14:01:47 Limit: medium.undef = 5.000000 >03/25/14 14:01:47 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:01:47 Phase 4.1: Negotiating with schedds ... >03/25/14 14:01:47 numSlots = 30 >03/25/14 14:01:47 slotWeightTotal = 30.000000 >03/25/14 14:01:47 pieLeft = 0.000 >03/25/14 14:01:47 NormalFactor = 1.000000 >03/25/14 14:01:47 MaxPrioValue = 0.651898 >03/25/14 14:01:47 NumSubmitterAds = 1 >03/25/14 14:01:47 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:01:47 0 seconds so far >03/25/14 14:01:47 Calculating submitter limit with the following parameters >03/25/14 14:01:47 SubmitterPrio = 0.651898 >03/25/14 14:01:47 SubmitterPrioFactor = 1.000000 >03/25/14 14:01:47 submitterShare = 1.000000 >03/25/14 14:01:47 submitterAbsShare = 1.000000 >03/25/14 14:01:47 submitterLimit = 0.000000 >03/25/14 14:01:47 submitterUsage = 30.000000 >03/25/14 14:01:47 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:01:47 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00011: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: large.test is 13.000000 >03/25/14 14:01:47 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:01:47 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00025: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:01:47 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:47 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00042: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: small.test is 2.000000 >03/25/14 14:01:47 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:01:47 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00063: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: test is 3.000000 >03/25/14 14:01:47 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:01:47 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00081: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:01:47 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:47 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00101: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: undef is 1.000000 >03/25/14 14:01:47 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:01:47 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got JOB_INFO command; getting classad/eom >03/25/14 14:01:47 Request 00001.00125: >03/25/14 14:01:47 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:01:47 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:01:47 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:01:47 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:01:47 Sending SEND_JOB_INFO/eom >03/25/14 14:01:47 Getting reply from schedd ... >03/25/14 14:01:47 Got NO_MORE_JOBS; done negotiating >03/25/14 14:01:47 This submitter hit its submitterLimit. >03/25/14 14:01:47 resources used scheddUsed= 30.000000 >03/25/14 14:01:47 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:01:47 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:01:47 Getting monitoring info for pid 22893 >03/25/14 14:01:48 Getting monitoring info for pid 22893 >03/25/14 14:01:49 Getting monitoring info for pid 22893 >03/25/14 14:01:50 Getting monitoring info for pid 22893 >03/25/14 14:01:51 Getting monitoring info for pid 22893 >03/25/14 14:01:52 Getting monitoring info for pid 22893 >03/25/14 14:01:53 Getting monitoring info for pid 22893 >03/25/14 14:01:54 Getting monitoring info for pid 22893 >03/25/14 14:01:55 Getting monitoring info for pid 22893 >03/25/14 14:01:56 Getting monitoring info for pid 22893 >03/25/14 14:01:57 Getting monitoring info for pid 22893 >03/25/14 14:01:58 Getting monitoring info for pid 22893 >03/25/14 14:01:59 Getting monitoring info for pid 22893 >03/25/14 14:02:00 Getting monitoring info for pid 22893 >03/25/14 14:02:01 Getting monitoring info for pid 22893 >03/25/14 14:02:02 Getting monitoring info for pid 22893 >03/25/14 14:02:03 Getting monitoring info for pid 22893 >03/25/14 14:02:04 Getting monitoring info for pid 22893 >03/25/14 14:02:05 Getting monitoring info for pid 22893 >03/25/14 14:02:06 Getting monitoring info for pid 22893 >03/25/14 14:02:08 ---------- Started Negotiation Cycle ---------- >03/25/14 14:02:08 Phase 1: Obtaining ads from collector ... >03/25/14 14:02:08 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:02:08 Trying to query collector <IP:9618> >03/25/14 14:02:08 Sorting 32 ads ... >03/25/14 14:02:08 Getting startd private ads ... >03/25/14 14:02:08 Trying to query collector <IP:9618> >03/25/14 14:02:08 Got ads: 32 public and 30 private >03/25/14 14:02:08 Public ads include 1 submitter, 30 startd >03/25/14 14:02:08 Phase 2: Performing accounting ... >03/25/14 14:02:08 Entering compute_significant_attrs() >03/25/14 14:02:08 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:02:08 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:02:08 CustomerName=Customer.<none> , Old Priority=0.652 , New Priority=0.657 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=19935.000 (unweighted 19935.000), BeginUsageTime=1395751882 >03/25/14 14:02:08 CustomerName=Customer.test@<hostname> , Old Priority=0.652 , New Priority=0.657 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=19935.000 (unweighted 19935.000), BeginUsageTime=1395751882 >03/25/14 14:02:08 (Accountant) Checking Matches >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:02:08 Match already existed! >03/25/14 14:02:08 Previous Limits -- >03/25/14 14:02:08 Limit: test = 3.000000 >03/25/14 14:02:08 Limit: small.test = 2.000000 >03/25/14 14:02:08 Limit: medium.test = 5.000000 >03/25/14 14:02:08 Limit: undef.test = 1.000000 >03/25/14 14:02:08 Limit: undef = 1.000000 >03/25/14 14:02:08 Limit: large.test = 13.000000 >03/25/14 14:02:08 Limit: medium.undef = 5.000000 >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(medium.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(medium.undef) >03/25/14 14:02:08 IncrementLimit(small.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(medium.undef) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(medium.undef) >03/25/14 14:02:08 IncrementLimit(medium.undef) >03/25/14 14:02:08 IncrementLimit(medium.undef) >03/25/14 14:02:08 IncrementLimit(small.test) >03/25/14 14:02:08 IncrementLimit(test) >03/25/14 14:02:08 IncrementLimit(medium.test) >03/25/14 14:02:08 IncrementLimit(test) >03/25/14 14:02:08 IncrementLimit(medium.test) >03/25/14 14:02:08 IncrementLimit(test) >03/25/14 14:02:08 IncrementLimit(medium.test) >03/25/14 14:02:08 IncrementLimit(undef.test) >03/25/14 14:02:08 IncrementLimit(medium.test) >03/25/14 14:02:08 IncrementLimit(undef) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 IncrementLimit(large.test) >03/25/14 14:02:08 Current Limits -- >03/25/14 14:02:08 Limit: test = 3.000000 >03/25/14 14:02:08 Limit: small.test = 2.000000 >03/25/14 14:02:08 Limit: medium.test = 5.000000 >03/25/14 14:02:08 Limit: undef.test = 1.000000 >03/25/14 14:02:08 Limit: undef = 1.000000 >03/25/14 14:02:08 Limit: large.test = 13.000000 >03/25/14 14:02:08 Limit: medium.undef = 5.000000 >03/25/14 14:02:08 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:02:08 Phase 4.1: Negotiating with schedds ... >03/25/14 14:02:08 numSlots = 30 >03/25/14 14:02:08 slotWeightTotal = 30.000000 >03/25/14 14:02:08 pieLeft = 0.000 >03/25/14 14:02:08 NormalFactor = 1.000000 >03/25/14 14:02:08 MaxPrioValue = 0.656842 >03/25/14 14:02:08 NumSubmitterAds = 1 >03/25/14 14:02:08 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:02:08 0 seconds so far >03/25/14 14:02:08 Calculating submitter limit with the following parameters >03/25/14 14:02:08 SubmitterPrio = 0.656842 >03/25/14 14:02:08 SubmitterPrioFactor = 1.000000 >03/25/14 14:02:08 submitterShare = 1.000000 >03/25/14 14:02:08 submitterAbsShare = 1.000000 >03/25/14 14:02:08 submitterLimit = 0.000000 >03/25/14 14:02:08 submitterUsage = 30.000000 >03/25/14 14:02:08 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:02:08 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00011: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: large.test is 13.000000 >03/25/14 14:02:08 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:02:08 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00025: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:02:08 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:08 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00042: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: small.test is 2.000000 >03/25/14 14:02:08 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:02:08 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00063: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: test is 3.000000 >03/25/14 14:02:08 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:02:08 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00081: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:02:08 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:08 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00101: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: undef is 1.000000 >03/25/14 14:02:08 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:08 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:08 Request 00001.00125: >03/25/14 14:02:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:08 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:02:08 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:08 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:02:08 Sending SEND_JOB_INFO/eom >03/25/14 14:02:08 Getting reply from schedd ... >03/25/14 14:02:08 Got NO_MORE_JOBS; done negotiating >03/25/14 14:02:08 This submitter hit its submitterLimit. >03/25/14 14:02:08 resources used scheddUsed= 30.000000 >03/25/14 14:02:08 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:02:08 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:02:08 Getting monitoring info for pid 22893 >03/25/14 14:02:09 Getting monitoring info for pid 22893 >03/25/14 14:02:10 Getting monitoring info for pid 22893 >03/25/14 14:02:11 Getting monitoring info for pid 22893 >03/25/14 14:02:12 Getting monitoring info for pid 22893 >03/25/14 14:02:13 Getting monitoring info for pid 22893 >03/25/14 14:02:14 Getting monitoring info for pid 22893 >03/25/14 14:02:15 Getting monitoring info for pid 22893 >03/25/14 14:02:16 Getting monitoring info for pid 22893 >03/25/14 14:02:17 Getting monitoring info for pid 22893 >03/25/14 14:02:18 Getting monitoring info for pid 22893 >03/25/14 14:02:19 Getting monitoring info for pid 22893 >03/25/14 14:02:20 Getting monitoring info for pid 22893 >03/25/14 14:02:21 Getting monitoring info for pid 22893 >03/25/14 14:02:22 Getting monitoring info for pid 22893 >03/25/14 14:02:23 Getting monitoring info for pid 22893 >03/25/14 14:02:24 Getting monitoring info for pid 22893 >03/25/14 14:02:25 Getting monitoring info for pid 22893 >03/25/14 14:02:26 Getting monitoring info for pid 22893 >03/25/14 14:02:27 Getting monitoring info for pid 22893 >03/25/14 14:02:28 ---------- Started Negotiation Cycle ---------- >03/25/14 14:02:28 Phase 1: Obtaining ads from collector ... >03/25/14 14:02:28 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:02:28 Trying to query collector <IP:9618> >03/25/14 14:02:28 Sorting 32 ads ... >03/25/14 14:02:28 Getting startd private ads ... >03/25/14 14:02:28 Trying to query collector <IP:9618> >03/25/14 14:02:28 Got ads: 32 public and 30 private >03/25/14 14:02:28 Public ads include 1 submitter, 30 startd >03/25/14 14:02:28 Phase 2: Performing accounting ... >03/25/14 14:02:28 Entering compute_significant_attrs() >03/25/14 14:02:28 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:02:28 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:02:28 CustomerName=Customer.<none> , Old Priority=0.657 , New Priority=0.662 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=20535.000 (unweighted 20535.000), BeginUsageTime=1395751882 >03/25/14 14:02:28 CustomerName=Customer.test@<hostname> , Old Priority=0.657 , New Priority=0.662 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=20535.000 (unweighted 20535.000), BeginUsageTime=1395751882 >03/25/14 14:02:28 (Accountant) Checking Matches >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:02:28 Match already existed! >03/25/14 14:02:28 Previous Limits -- >03/25/14 14:02:28 Limit: test = 3.000000 >03/25/14 14:02:28 Limit: small.test = 2.000000 >03/25/14 14:02:28 Limit: medium.test = 5.000000 >03/25/14 14:02:28 Limit: undef.test = 1.000000 >03/25/14 14:02:28 Limit: undef = 1.000000 >03/25/14 14:02:28 Limit: large.test = 13.000000 >03/25/14 14:02:28 Limit: medium.undef = 5.000000 >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(medium.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(medium.undef) >03/25/14 14:02:28 IncrementLimit(small.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(medium.undef) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(medium.undef) >03/25/14 14:02:28 IncrementLimit(medium.undef) >03/25/14 14:02:28 IncrementLimit(medium.undef) >03/25/14 14:02:28 IncrementLimit(small.test) >03/25/14 14:02:28 IncrementLimit(test) >03/25/14 14:02:28 IncrementLimit(medium.test) >03/25/14 14:02:28 IncrementLimit(test) >03/25/14 14:02:28 IncrementLimit(medium.test) >03/25/14 14:02:28 IncrementLimit(test) >03/25/14 14:02:28 IncrementLimit(medium.test) >03/25/14 14:02:28 IncrementLimit(undef.test) >03/25/14 14:02:28 IncrementLimit(medium.test) >03/25/14 14:02:28 IncrementLimit(undef) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 IncrementLimit(large.test) >03/25/14 14:02:28 Current Limits -- >03/25/14 14:02:28 Limit: test = 3.000000 >03/25/14 14:02:28 Limit: small.test = 2.000000 >03/25/14 14:02:28 Limit: medium.test = 5.000000 >03/25/14 14:02:28 Limit: undef.test = 1.000000 >03/25/14 14:02:28 Limit: undef = 1.000000 >03/25/14 14:02:28 Limit: large.test = 13.000000 >03/25/14 14:02:28 Limit: medium.undef = 5.000000 >03/25/14 14:02:28 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:02:28 Phase 4.1: Negotiating with schedds ... >03/25/14 14:02:28 numSlots = 30 >03/25/14 14:02:28 slotWeightTotal = 30.000000 >03/25/14 14:02:28 pieLeft = 0.000 >03/25/14 14:02:28 NormalFactor = 1.000000 >03/25/14 14:02:28 MaxPrioValue = 0.661550 >03/25/14 14:02:28 NumSubmitterAds = 1 >03/25/14 14:02:28 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:02:28 0 seconds so far >03/25/14 14:02:28 Calculating submitter limit with the following parameters >03/25/14 14:02:28 SubmitterPrio = 0.661550 >03/25/14 14:02:28 SubmitterPrioFactor = 1.000000 >03/25/14 14:02:28 submitterShare = 1.000000 >03/25/14 14:02:28 submitterAbsShare = 1.000000 >03/25/14 14:02:28 submitterLimit = 0.000000 >03/25/14 14:02:28 submitterUsage = 30.000000 >03/25/14 14:02:28 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:02:28 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00011: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: large.test is 13.000000 >03/25/14 14:02:28 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:02:28 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00025: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:02:28 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:28 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00042: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: small.test is 2.000000 >03/25/14 14:02:28 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:02:28 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00063: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: test is 3.000000 >03/25/14 14:02:28 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:02:28 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00081: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:02:28 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:28 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00101: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: undef is 1.000000 >03/25/14 14:02:28 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:28 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:28 Request 00001.00125: >03/25/14 14:02:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:28 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:02:28 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:28 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:02:28 Sending SEND_JOB_INFO/eom >03/25/14 14:02:28 Getting reply from schedd ... >03/25/14 14:02:28 Got NO_MORE_JOBS; done negotiating >03/25/14 14:02:28 This submitter hit its submitterLimit. >03/25/14 14:02:28 resources used scheddUsed= 30.000000 >03/25/14 14:02:28 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:02:28 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:02:28 Getting monitoring info for pid 22893 >03/25/14 14:02:29 Getting monitoring info for pid 22893 >03/25/14 14:02:30 Getting monitoring info for pid 22893 >03/25/14 14:02:31 Getting monitoring info for pid 22893 >03/25/14 14:02:32 Getting monitoring info for pid 22893 >03/25/14 14:02:33 Getting monitoring info for pid 22893 >03/25/14 14:02:34 Getting monitoring info for pid 22893 >03/25/14 14:02:35 Getting monitoring info for pid 22893 >03/25/14 14:02:36 Getting monitoring info for pid 22893 >03/25/14 14:02:37 Getting monitoring info for pid 22893 >03/25/14 14:02:38 Getting monitoring info for pid 22893 >03/25/14 14:02:39 Getting monitoring info for pid 22893 >03/25/14 14:02:40 Getting monitoring info for pid 22893 >03/25/14 14:02:41 Getting monitoring info for pid 22893 >03/25/14 14:02:42 Getting monitoring info for pid 22893 >03/25/14 14:02:43 Getting monitoring info for pid 22893 >03/25/14 14:02:44 Getting monitoring info for pid 22893 >03/25/14 14:02:45 Getting monitoring info for pid 22893 >03/25/14 14:02:46 Getting monitoring info for pid 22893 >03/25/14 14:02:47 Getting monitoring info for pid 22893 >03/25/14 14:02:48 ---------- Started Negotiation Cycle ---------- >03/25/14 14:02:48 Phase 1: Obtaining ads from collector ... >03/25/14 14:02:48 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:02:48 Trying to query collector <IP:9618> >03/25/14 14:02:48 Sorting 32 ads ... >03/25/14 14:02:48 Getting startd private ads ... >03/25/14 14:02:48 Trying to query collector <IP:9618> >03/25/14 14:02:48 Got ads: 32 public and 30 private >03/25/14 14:02:48 Public ads include 1 submitter, 30 startd >03/25/14 14:02:48 Phase 2: Performing accounting ... >03/25/14 14:02:48 Entering compute_significant_attrs() >03/25/14 14:02:48 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:02:48 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:02:48 CustomerName=Customer.<none> , Old Priority=0.662 , New Priority=0.666 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=21135.000 (unweighted 21135.000), BeginUsageTime=1395751882 >03/25/14 14:02:48 CustomerName=Customer.test@<hostname> , Old Priority=0.662 , New Priority=0.666 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:02:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=21135.000 (unweighted 21135.000), BeginUsageTime=1395751882 >03/25/14 14:02:48 (Accountant) Checking Matches >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:02:48 Match already existed! >03/25/14 14:02:48 Previous Limits -- >03/25/14 14:02:48 Limit: test = 3.000000 >03/25/14 14:02:48 Limit: small.test = 2.000000 >03/25/14 14:02:48 Limit: medium.test = 5.000000 >03/25/14 14:02:48 Limit: undef.test = 1.000000 >03/25/14 14:02:48 Limit: undef = 1.000000 >03/25/14 14:02:48 Limit: large.test = 13.000000 >03/25/14 14:02:48 Limit: medium.undef = 5.000000 >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(medium.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(medium.undef) >03/25/14 14:02:48 IncrementLimit(small.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(medium.undef) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(medium.undef) >03/25/14 14:02:48 IncrementLimit(medium.undef) >03/25/14 14:02:48 IncrementLimit(medium.undef) >03/25/14 14:02:48 IncrementLimit(small.test) >03/25/14 14:02:48 IncrementLimit(test) >03/25/14 14:02:48 IncrementLimit(medium.test) >03/25/14 14:02:48 IncrementLimit(test) >03/25/14 14:02:48 IncrementLimit(medium.test) >03/25/14 14:02:48 IncrementLimit(test) >03/25/14 14:02:48 IncrementLimit(medium.test) >03/25/14 14:02:48 IncrementLimit(undef.test) >03/25/14 14:02:48 IncrementLimit(medium.test) >03/25/14 14:02:48 IncrementLimit(undef) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 IncrementLimit(large.test) >03/25/14 14:02:48 Current Limits -- >03/25/14 14:02:48 Limit: test = 3.000000 >03/25/14 14:02:48 Limit: small.test = 2.000000 >03/25/14 14:02:48 Limit: medium.test = 5.000000 >03/25/14 14:02:48 Limit: undef.test = 1.000000 >03/25/14 14:02:48 Limit: undef = 1.000000 >03/25/14 14:02:48 Limit: large.test = 13.000000 >03/25/14 14:02:48 Limit: medium.undef = 5.000000 >03/25/14 14:02:48 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:02:48 Phase 4.1: Negotiating with schedds ... >03/25/14 14:02:48 numSlots = 30 >03/25/14 14:02:48 slotWeightTotal = 30.000000 >03/25/14 14:02:48 pieLeft = 0.000 >03/25/14 14:02:48 NormalFactor = 1.000000 >03/25/14 14:02:48 MaxPrioValue = 0.666258 >03/25/14 14:02:48 NumSubmitterAds = 1 >03/25/14 14:02:48 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:02:48 0 seconds so far >03/25/14 14:02:48 Calculating submitter limit with the following parameters >03/25/14 14:02:48 SubmitterPrio = 0.666258 >03/25/14 14:02:48 SubmitterPrioFactor = 1.000000 >03/25/14 14:02:48 submitterShare = 1.000000 >03/25/14 14:02:48 submitterAbsShare = 1.000000 >03/25/14 14:02:48 submitterLimit = 0.000000 >03/25/14 14:02:48 submitterUsage = 30.000000 >03/25/14 14:02:48 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:02:48 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00011: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: large.test is 13.000000 >03/25/14 14:02:48 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:02:48 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00025: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:02:48 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:48 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00042: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: small.test is 2.000000 >03/25/14 14:02:48 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:02:48 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00063: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: test is 3.000000 >03/25/14 14:02:48 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:02:48 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00081: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:02:48 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:48 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00101: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: undef is 1.000000 >03/25/14 14:02:48 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:02:48 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:02:48 Request 00001.00125: >03/25/14 14:02:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:02:48 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:02:48 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:02:48 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:02:48 Sending SEND_JOB_INFO/eom >03/25/14 14:02:48 Getting reply from schedd ... >03/25/14 14:02:48 Got NO_MORE_JOBS; done negotiating >03/25/14 14:02:48 This submitter hit its submitterLimit. >03/25/14 14:02:48 resources used scheddUsed= 30.000000 >03/25/14 14:02:48 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:02:48 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:02:48 Getting monitoring info for pid 22893 >03/25/14 14:02:49 Getting monitoring info for pid 22893 >03/25/14 14:02:50 Getting monitoring info for pid 22893 >03/25/14 14:02:51 Getting monitoring info for pid 22893 >03/25/14 14:02:52 Getting monitoring info for pid 22893 >03/25/14 14:02:53 Getting monitoring info for pid 22893 >03/25/14 14:02:54 Getting monitoring info for pid 22893 >03/25/14 14:02:55 Getting monitoring info for pid 22893 >03/25/14 14:02:56 Getting monitoring info for pid 22893 >03/25/14 14:02:57 Getting monitoring info for pid 22893 >03/25/14 14:02:58 Getting monitoring info for pid 22893 >03/25/14 14:02:59 Getting monitoring info for pid 22893 >03/25/14 14:03:00 Getting monitoring info for pid 22893 >03/25/14 14:03:01 Getting monitoring info for pid 22893 >03/25/14 14:03:02 Getting monitoring info for pid 22893 >03/25/14 14:03:03 Getting monitoring info for pid 22893 >03/25/14 14:03:04 Getting monitoring info for pid 22893 >03/25/14 14:03:05 Getting monitoring info for pid 22893 >03/25/14 14:03:06 Getting monitoring info for pid 22893 >03/25/14 14:03:07 Getting monitoring info for pid 22893 >03/25/14 14:03:08 ---------- Started Negotiation Cycle ---------- >03/25/14 14:03:08 Phase 1: Obtaining ads from collector ... >03/25/14 14:03:08 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:03:08 Trying to query collector <IP:9618> >03/25/14 14:03:08 Sorting 32 ads ... >03/25/14 14:03:08 Getting startd private ads ... >03/25/14 14:03:08 Trying to query collector <IP:9618> >03/25/14 14:03:08 Got ads: 32 public and 30 private >03/25/14 14:03:08 Public ads include 1 submitter, 30 startd >03/25/14 14:03:08 Phase 2: Performing accounting ... >03/25/14 14:03:08 Entering compute_significant_attrs() >03/25/14 14:03:08 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:03:08 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:03:08 CustomerName=Customer.<none> , Old Priority=0.666 , New Priority=0.671 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=21735.000 (unweighted 21735.000), BeginUsageTime=1395751882 >03/25/14 14:03:08 CustomerName=Customer.test@<hostname> , Old Priority=0.666 , New Priority=0.671 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=21735.000 (unweighted 21735.000), BeginUsageTime=1395751882 >03/25/14 14:03:08 (Accountant) Checking Matches >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:03:08 Match already existed! >03/25/14 14:03:08 Previous Limits -- >03/25/14 14:03:08 Limit: test = 3.000000 >03/25/14 14:03:08 Limit: small.test = 2.000000 >03/25/14 14:03:08 Limit: medium.test = 5.000000 >03/25/14 14:03:08 Limit: undef.test = 1.000000 >03/25/14 14:03:08 Limit: undef = 1.000000 >03/25/14 14:03:08 Limit: large.test = 13.000000 >03/25/14 14:03:08 Limit: medium.undef = 5.000000 >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(medium.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(medium.undef) >03/25/14 14:03:08 IncrementLimit(small.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(medium.undef) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(medium.undef) >03/25/14 14:03:08 IncrementLimit(medium.undef) >03/25/14 14:03:08 IncrementLimit(medium.undef) >03/25/14 14:03:08 IncrementLimit(small.test) >03/25/14 14:03:08 IncrementLimit(test) >03/25/14 14:03:08 IncrementLimit(medium.test) >03/25/14 14:03:08 IncrementLimit(test) >03/25/14 14:03:08 IncrementLimit(medium.test) >03/25/14 14:03:08 IncrementLimit(test) >03/25/14 14:03:08 IncrementLimit(medium.test) >03/25/14 14:03:08 IncrementLimit(undef.test) >03/25/14 14:03:08 IncrementLimit(medium.test) >03/25/14 14:03:08 IncrementLimit(undef) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 IncrementLimit(large.test) >03/25/14 14:03:08 Current Limits -- >03/25/14 14:03:08 Limit: test = 3.000000 >03/25/14 14:03:08 Limit: small.test = 2.000000 >03/25/14 14:03:08 Limit: medium.test = 5.000000 >03/25/14 14:03:08 Limit: undef.test = 1.000000 >03/25/14 14:03:08 Limit: undef = 1.000000 >03/25/14 14:03:08 Limit: large.test = 13.000000 >03/25/14 14:03:08 Limit: medium.undef = 5.000000 >03/25/14 14:03:08 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:03:08 Phase 4.1: Negotiating with schedds ... >03/25/14 14:03:08 numSlots = 30 >03/25/14 14:03:08 slotWeightTotal = 30.000000 >03/25/14 14:03:08 pieLeft = 0.000 >03/25/14 14:03:08 NormalFactor = 1.000000 >03/25/14 14:03:08 MaxPrioValue = 0.670965 >03/25/14 14:03:08 NumSubmitterAds = 1 >03/25/14 14:03:08 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:03:08 0 seconds so far >03/25/14 14:03:08 Calculating submitter limit with the following parameters >03/25/14 14:03:08 SubmitterPrio = 0.670965 >03/25/14 14:03:08 SubmitterPrioFactor = 1.000000 >03/25/14 14:03:08 submitterShare = 1.000000 >03/25/14 14:03:08 submitterAbsShare = 1.000000 >03/25/14 14:03:08 submitterLimit = 0.000000 >03/25/14 14:03:08 submitterUsage = 30.000000 >03/25/14 14:03:08 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:03:08 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00011: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: large.test is 13.000000 >03/25/14 14:03:08 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:03:08 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00025: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:03:08 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:08 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00042: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: small.test is 2.000000 >03/25/14 14:03:08 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:03:08 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00063: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: test is 3.000000 >03/25/14 14:03:08 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:03:08 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00081: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:03:08 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:08 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00101: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: undef is 1.000000 >03/25/14 14:03:08 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:08 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:08 Request 00001.00125: >03/25/14 14:03:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:08 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:03:08 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:08 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:03:08 Sending SEND_JOB_INFO/eom >03/25/14 14:03:08 Getting reply from schedd ... >03/25/14 14:03:08 Got NO_MORE_JOBS; done negotiating >03/25/14 14:03:08 This submitter hit its submitterLimit. >03/25/14 14:03:08 resources used scheddUsed= 30.000000 >03/25/14 14:03:08 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:03:08 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:03:08 Getting monitoring info for pid 22893 >03/25/14 14:03:09 Getting monitoring info for pid 22893 >03/25/14 14:03:10 Getting monitoring info for pid 22893 >03/25/14 14:03:11 Getting monitoring info for pid 22893 >03/25/14 14:03:12 Getting monitoring info for pid 22893 >03/25/14 14:03:13 Getting monitoring info for pid 22893 >03/25/14 14:03:15 Getting monitoring info for pid 22893 >03/25/14 14:03:16 Getting monitoring info for pid 22893 >03/25/14 14:03:17 Getting monitoring info for pid 22893 >03/25/14 14:03:18 Getting monitoring info for pid 22893 >03/25/14 14:03:19 Getting monitoring info for pid 22893 >03/25/14 14:03:20 Getting monitoring info for pid 22893 >03/25/14 14:03:21 Getting monitoring info for pid 22893 >03/25/14 14:03:22 Getting monitoring info for pid 22893 >03/25/14 14:03:23 Getting monitoring info for pid 22893 >03/25/14 14:03:24 Getting monitoring info for pid 22893 >03/25/14 14:03:25 Getting monitoring info for pid 22893 >03/25/14 14:03:26 Getting monitoring info for pid 22893 >03/25/14 14:03:27 Getting monitoring info for pid 22893 >03/25/14 14:03:28 ---------- Started Negotiation Cycle ---------- >03/25/14 14:03:28 Phase 1: Obtaining ads from collector ... >03/25/14 14:03:28 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:03:28 Trying to query collector <IP:9618> >03/25/14 14:03:28 Sorting 32 ads ... >03/25/14 14:03:28 Getting startd private ads ... >03/25/14 14:03:28 Trying to query collector <IP:9618> >03/25/14 14:03:28 Got ads: 32 public and 30 private >03/25/14 14:03:28 Public ads include 1 submitter, 30 startd >03/25/14 14:03:28 Phase 2: Performing accounting ... >03/25/14 14:03:28 Entering compute_significant_attrs() >03/25/14 14:03:28 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:03:28 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:03:28 CustomerName=Customer.<none> , Old Priority=0.671 , New Priority=0.676 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=22335.000 (unweighted 22335.000), BeginUsageTime=1395751882 >03/25/14 14:03:28 CustomerName=Customer.test@<hostname> , Old Priority=0.671 , New Priority=0.676 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=22335.000 (unweighted 22335.000), BeginUsageTime=1395751882 >03/25/14 14:03:28 (Accountant) Checking Matches >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:03:28 Match already existed! >03/25/14 14:03:28 Previous Limits -- >03/25/14 14:03:28 Limit: test = 3.000000 >03/25/14 14:03:28 Limit: small.test = 2.000000 >03/25/14 14:03:28 Limit: medium.test = 5.000000 >03/25/14 14:03:28 Limit: undef.test = 1.000000 >03/25/14 14:03:28 Limit: undef = 1.000000 >03/25/14 14:03:28 Limit: large.test = 13.000000 >03/25/14 14:03:28 Limit: medium.undef = 5.000000 >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(medium.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(medium.undef) >03/25/14 14:03:28 IncrementLimit(small.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(medium.undef) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(medium.undef) >03/25/14 14:03:28 IncrementLimit(medium.undef) >03/25/14 14:03:28 IncrementLimit(medium.undef) >03/25/14 14:03:28 IncrementLimit(small.test) >03/25/14 14:03:28 IncrementLimit(test) >03/25/14 14:03:28 IncrementLimit(medium.test) >03/25/14 14:03:28 IncrementLimit(test) >03/25/14 14:03:28 IncrementLimit(medium.test) >03/25/14 14:03:28 IncrementLimit(test) >03/25/14 14:03:28 IncrementLimit(medium.test) >03/25/14 14:03:28 IncrementLimit(undef.test) >03/25/14 14:03:28 IncrementLimit(medium.test) >03/25/14 14:03:28 IncrementLimit(undef) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 IncrementLimit(large.test) >03/25/14 14:03:28 Current Limits -- >03/25/14 14:03:28 Limit: test = 3.000000 >03/25/14 14:03:28 Limit: small.test = 2.000000 >03/25/14 14:03:28 Limit: medium.test = 5.000000 >03/25/14 14:03:28 Limit: undef.test = 1.000000 >03/25/14 14:03:28 Limit: undef = 1.000000 >03/25/14 14:03:28 Limit: large.test = 13.000000 >03/25/14 14:03:28 Limit: medium.undef = 5.000000 >03/25/14 14:03:28 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:03:28 Phase 4.1: Negotiating with schedds ... >03/25/14 14:03:28 numSlots = 30 >03/25/14 14:03:28 slotWeightTotal = 30.000000 >03/25/14 14:03:28 pieLeft = 0.000 >03/25/14 14:03:28 NormalFactor = 1.000000 >03/25/14 14:03:28 MaxPrioValue = 0.675671 >03/25/14 14:03:28 NumSubmitterAds = 1 >03/25/14 14:03:28 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:03:28 0 seconds so far >03/25/14 14:03:28 Calculating submitter limit with the following parameters >03/25/14 14:03:28 SubmitterPrio = 0.675671 >03/25/14 14:03:28 SubmitterPrioFactor = 1.000000 >03/25/14 14:03:28 submitterShare = 1.000000 >03/25/14 14:03:28 submitterAbsShare = 1.000000 >03/25/14 14:03:28 submitterLimit = 0.000000 >03/25/14 14:03:28 submitterUsage = 30.000000 >03/25/14 14:03:28 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:03:28 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00011: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: large.test is 13.000000 >03/25/14 14:03:28 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:03:28 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00025: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:03:28 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:28 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00042: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: small.test is 2.000000 >03/25/14 14:03:28 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:03:28 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00063: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: test is 3.000000 >03/25/14 14:03:28 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:03:28 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00081: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:03:28 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:28 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00101: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: undef is 1.000000 >03/25/14 14:03:28 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:28 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:28 Request 00001.00125: >03/25/14 14:03:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:28 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:03:28 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:28 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:03:28 Sending SEND_JOB_INFO/eom >03/25/14 14:03:28 Getting reply from schedd ... >03/25/14 14:03:28 Got NO_MORE_JOBS; done negotiating >03/25/14 14:03:28 This submitter hit its submitterLimit. >03/25/14 14:03:28 resources used scheddUsed= 30.000000 >03/25/14 14:03:28 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:03:28 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:03:28 Getting monitoring info for pid 22893 >03/25/14 14:03:29 Getting monitoring info for pid 22893 >03/25/14 14:03:30 Getting monitoring info for pid 22893 >03/25/14 14:03:31 Getting monitoring info for pid 22893 >03/25/14 14:03:32 Getting monitoring info for pid 22893 >03/25/14 14:03:33 Getting monitoring info for pid 22893 >03/25/14 14:03:34 Getting monitoring info for pid 22893 >03/25/14 14:03:35 Getting monitoring info for pid 22893 >03/25/14 14:03:36 Getting monitoring info for pid 22893 >03/25/14 14:03:37 Getting monitoring info for pid 22893 >03/25/14 14:03:38 Getting monitoring info for pid 22893 >03/25/14 14:03:39 Getting monitoring info for pid 22893 >03/25/14 14:03:40 Getting monitoring info for pid 22893 >03/25/14 14:03:41 Getting monitoring info for pid 22893 >03/25/14 14:03:42 Getting monitoring info for pid 22893 >03/25/14 14:03:43 Getting monitoring info for pid 22893 >03/25/14 14:03:44 Getting monitoring info for pid 22893 >03/25/14 14:03:45 Getting monitoring info for pid 22893 >03/25/14 14:03:46 Getting monitoring info for pid 22893 >03/25/14 14:03:47 Getting monitoring info for pid 22893 >03/25/14 14:03:48 ---------- Started Negotiation Cycle ---------- >03/25/14 14:03:48 Phase 1: Obtaining ads from collector ... >03/25/14 14:03:48 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:03:48 Trying to query collector <IP:9618> >03/25/14 14:03:48 Sorting 32 ads ... >03/25/14 14:03:48 Getting startd private ads ... >03/25/14 14:03:48 Trying to query collector <IP:9618> >03/25/14 14:03:48 Got ads: 32 public and 30 private >03/25/14 14:03:48 Public ads include 1 submitter, 30 startd >03/25/14 14:03:48 Phase 2: Performing accounting ... >03/25/14 14:03:48 Entering compute_significant_attrs() >03/25/14 14:03:48 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:03:48 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:03:48 CustomerName=Customer.<none> , Old Priority=0.676 , New Priority=0.680 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=22935.000 (unweighted 22935.000), BeginUsageTime=1395751882 >03/25/14 14:03:48 CustomerName=Customer.test@<hostname> , Old Priority=0.676 , New Priority=0.680 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:03:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=22935.000 (unweighted 22935.000), BeginUsageTime=1395751882 >03/25/14 14:03:48 (Accountant) Checking Matches >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:03:48 Match already existed! >03/25/14 14:03:48 Previous Limits -- >03/25/14 14:03:48 Limit: test = 3.000000 >03/25/14 14:03:48 Limit: small.test = 2.000000 >03/25/14 14:03:48 Limit: medium.test = 5.000000 >03/25/14 14:03:48 Limit: undef.test = 1.000000 >03/25/14 14:03:48 Limit: undef = 1.000000 >03/25/14 14:03:48 Limit: large.test = 13.000000 >03/25/14 14:03:48 Limit: medium.undef = 5.000000 >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(medium.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(medium.undef) >03/25/14 14:03:48 IncrementLimit(small.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(medium.undef) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(medium.undef) >03/25/14 14:03:48 IncrementLimit(medium.undef) >03/25/14 14:03:48 IncrementLimit(medium.undef) >03/25/14 14:03:48 IncrementLimit(small.test) >03/25/14 14:03:48 IncrementLimit(test) >03/25/14 14:03:48 IncrementLimit(medium.test) >03/25/14 14:03:48 IncrementLimit(test) >03/25/14 14:03:48 IncrementLimit(medium.test) >03/25/14 14:03:48 IncrementLimit(test) >03/25/14 14:03:48 IncrementLimit(medium.test) >03/25/14 14:03:48 IncrementLimit(undef.test) >03/25/14 14:03:48 IncrementLimit(medium.test) >03/25/14 14:03:48 IncrementLimit(undef) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 IncrementLimit(large.test) >03/25/14 14:03:48 Current Limits -- >03/25/14 14:03:48 Limit: test = 3.000000 >03/25/14 14:03:48 Limit: small.test = 2.000000 >03/25/14 14:03:48 Limit: medium.test = 5.000000 >03/25/14 14:03:48 Limit: undef.test = 1.000000 >03/25/14 14:03:48 Limit: undef = 1.000000 >03/25/14 14:03:48 Limit: large.test = 13.000000 >03/25/14 14:03:48 Limit: medium.undef = 5.000000 >03/25/14 14:03:48 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:03:48 Phase 4.1: Negotiating with schedds ... >03/25/14 14:03:48 numSlots = 30 >03/25/14 14:03:48 slotWeightTotal = 30.000000 >03/25/14 14:03:48 pieLeft = 0.000 >03/25/14 14:03:48 NormalFactor = 1.000000 >03/25/14 14:03:48 MaxPrioValue = 0.680376 >03/25/14 14:03:48 NumSubmitterAds = 1 >03/25/14 14:03:48 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:03:48 0 seconds so far >03/25/14 14:03:48 Calculating submitter limit with the following parameters >03/25/14 14:03:48 SubmitterPrio = 0.680376 >03/25/14 14:03:48 SubmitterPrioFactor = 1.000000 >03/25/14 14:03:48 submitterShare = 1.000000 >03/25/14 14:03:48 submitterAbsShare = 1.000000 >03/25/14 14:03:48 submitterLimit = 0.000000 >03/25/14 14:03:48 submitterUsage = 30.000000 >03/25/14 14:03:48 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:03:48 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00011: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: large.test is 13.000000 >03/25/14 14:03:48 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:03:48 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00025: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:03:48 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:48 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00042: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: small.test is 2.000000 >03/25/14 14:03:48 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:03:48 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00063: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: test is 3.000000 >03/25/14 14:03:48 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:03:48 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00081: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:03:48 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:48 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00101: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: undef is 1.000000 >03/25/14 14:03:48 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:03:48 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got JOB_INFO command; getting classad/eom >03/25/14 14:03:48 Request 00001.00125: >03/25/14 14:03:48 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:03:48 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:03:48 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:03:48 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:03:48 Sending SEND_JOB_INFO/eom >03/25/14 14:03:48 Getting reply from schedd ... >03/25/14 14:03:48 Got NO_MORE_JOBS; done negotiating >03/25/14 14:03:48 This submitter hit its submitterLimit. >03/25/14 14:03:48 resources used scheddUsed= 30.000000 >03/25/14 14:03:48 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:03:48 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:03:48 Getting monitoring info for pid 22893 >03/25/14 14:03:49 Getting monitoring info for pid 22893 >03/25/14 14:03:50 Getting monitoring info for pid 22893 >03/25/14 14:03:51 Getting monitoring info for pid 22893 >03/25/14 14:03:52 Getting monitoring info for pid 22893 >03/25/14 14:03:53 Getting monitoring info for pid 22893 >03/25/14 14:03:54 Getting monitoring info for pid 22893 >03/25/14 14:03:55 Getting monitoring info for pid 22893 >03/25/14 14:03:56 Getting monitoring info for pid 22893 >03/25/14 14:03:57 Getting monitoring info for pid 22893 >03/25/14 14:03:58 Getting monitoring info for pid 22893 >03/25/14 14:03:59 Getting monitoring info for pid 22893 >03/25/14 14:04:00 Getting monitoring info for pid 22893 >03/25/14 14:04:01 Getting monitoring info for pid 22893 >03/25/14 14:04:02 Getting monitoring info for pid 22893 >03/25/14 14:04:03 Getting monitoring info for pid 22893 >03/25/14 14:04:04 Getting monitoring info for pid 22893 >03/25/14 14:04:05 Getting monitoring info for pid 22893 >03/25/14 14:04:06 Getting monitoring info for pid 22893 >03/25/14 14:04:07 Getting monitoring info for pid 22893 >03/25/14 14:04:08 ---------- Started Negotiation Cycle ---------- >03/25/14 14:04:08 Phase 1: Obtaining ads from collector ... >03/25/14 14:04:08 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:04:08 Trying to query collector <IP:9618> >03/25/14 14:04:08 Sorting 32 ads ... >03/25/14 14:04:08 Getting startd private ads ... >03/25/14 14:04:08 Trying to query collector <IP:9618> >03/25/14 14:04:08 Got ads: 32 public and 30 private >03/25/14 14:04:08 Public ads include 1 submitter, 30 startd >03/25/14 14:04:08 Phase 2: Performing accounting ... >03/25/14 14:04:08 Entering compute_significant_attrs() >03/25/14 14:04:08 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:04:08 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:04:08 CustomerName=Customer.<none> , Old Priority=0.680 , New Priority=0.685 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=23535.000 (unweighted 23535.000), BeginUsageTime=1395751882 >03/25/14 14:04:08 CustomerName=Customer.test@<hostname> , Old Priority=0.680 , New Priority=0.685 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:08 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=23535.000 (unweighted 23535.000), BeginUsageTime=1395751882 >03/25/14 14:04:08 (Accountant) Checking Matches >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:04:08 Match already existed! >03/25/14 14:04:08 Previous Limits -- >03/25/14 14:04:08 Limit: test = 3.000000 >03/25/14 14:04:08 Limit: small.test = 2.000000 >03/25/14 14:04:08 Limit: medium.test = 5.000000 >03/25/14 14:04:08 Limit: undef.test = 1.000000 >03/25/14 14:04:08 Limit: undef = 1.000000 >03/25/14 14:04:08 Limit: large.test = 13.000000 >03/25/14 14:04:08 Limit: medium.undef = 5.000000 >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(medium.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(medium.undef) >03/25/14 14:04:08 IncrementLimit(small.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(medium.undef) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(medium.undef) >03/25/14 14:04:08 IncrementLimit(medium.undef) >03/25/14 14:04:08 IncrementLimit(medium.undef) >03/25/14 14:04:08 IncrementLimit(small.test) >03/25/14 14:04:08 IncrementLimit(test) >03/25/14 14:04:08 IncrementLimit(medium.test) >03/25/14 14:04:08 IncrementLimit(test) >03/25/14 14:04:08 IncrementLimit(medium.test) >03/25/14 14:04:08 IncrementLimit(test) >03/25/14 14:04:08 IncrementLimit(medium.test) >03/25/14 14:04:08 IncrementLimit(undef.test) >03/25/14 14:04:08 IncrementLimit(medium.test) >03/25/14 14:04:08 IncrementLimit(undef) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 IncrementLimit(large.test) >03/25/14 14:04:08 Current Limits -- >03/25/14 14:04:08 Limit: test = 3.000000 >03/25/14 14:04:08 Limit: small.test = 2.000000 >03/25/14 14:04:08 Limit: medium.test = 5.000000 >03/25/14 14:04:08 Limit: undef.test = 1.000000 >03/25/14 14:04:08 Limit: undef = 1.000000 >03/25/14 14:04:08 Limit: large.test = 13.000000 >03/25/14 14:04:08 Limit: medium.undef = 5.000000 >03/25/14 14:04:08 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:04:08 Phase 4.1: Negotiating with schedds ... >03/25/14 14:04:08 numSlots = 30 >03/25/14 14:04:08 slotWeightTotal = 30.000000 >03/25/14 14:04:08 pieLeft = 0.000 >03/25/14 14:04:08 NormalFactor = 1.000000 >03/25/14 14:04:08 MaxPrioValue = 0.685080 >03/25/14 14:04:08 NumSubmitterAds = 1 >03/25/14 14:04:08 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:04:08 0 seconds so far >03/25/14 14:04:08 Calculating submitter limit with the following parameters >03/25/14 14:04:08 SubmitterPrio = 0.685080 >03/25/14 14:04:08 SubmitterPrioFactor = 1.000000 >03/25/14 14:04:08 submitterShare = 1.000000 >03/25/14 14:04:08 submitterAbsShare = 1.000000 >03/25/14 14:04:08 submitterLimit = 0.000000 >03/25/14 14:04:08 submitterUsage = 30.000000 >03/25/14 14:04:08 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:04:08 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00011: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: large.test is 13.000000 >03/25/14 14:04:08 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:04:08 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00025: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:04:08 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:08 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00042: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: small.test is 2.000000 >03/25/14 14:04:08 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:04:08 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00063: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: test is 3.000000 >03/25/14 14:04:08 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:04:08 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00081: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:04:08 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:08 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00101: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: undef is 1.000000 >03/25/14 14:04:08 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:08 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:08 Request 00001.00125: >03/25/14 14:04:08 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:08 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:04:08 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:08 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:04:08 Sending SEND_JOB_INFO/eom >03/25/14 14:04:08 Getting reply from schedd ... >03/25/14 14:04:08 Got NO_MORE_JOBS; done negotiating >03/25/14 14:04:08 This submitter hit its submitterLimit. >03/25/14 14:04:08 resources used scheddUsed= 30.000000 >03/25/14 14:04:08 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:04:08 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:04:08 Getting monitoring info for pid 22893 >03/25/14 14:04:09 Getting monitoring info for pid 22893 >03/25/14 14:04:10 Getting monitoring info for pid 22893 >03/25/14 14:04:11 Getting monitoring info for pid 22893 >03/25/14 14:04:12 Getting monitoring info for pid 22893 >03/25/14 14:04:13 Getting monitoring info for pid 22893 >03/25/14 14:04:14 Getting monitoring info for pid 22893 >03/25/14 14:04:15 Getting monitoring info for pid 22893 >03/25/14 14:04:16 Getting monitoring info for pid 22893 >03/25/14 14:04:17 Getting monitoring info for pid 22893 >03/25/14 14:04:18 Getting monitoring info for pid 22893 >03/25/14 14:04:19 Getting monitoring info for pid 22893 >03/25/14 14:04:20 Getting monitoring info for pid 22893 >03/25/14 14:04:21 Getting monitoring info for pid 22893 >03/25/14 14:04:22 Getting monitoring info for pid 22893 >03/25/14 14:04:23 Getting monitoring info for pid 22893 >03/25/14 14:04:24 Getting monitoring info for pid 22893 >03/25/14 14:04:25 Getting monitoring info for pid 22893 >03/25/14 14:04:26 Getting monitoring info for pid 22893 >03/25/14 14:04:27 Getting monitoring info for pid 22893 >03/25/14 14:04:28 ---------- Started Negotiation Cycle ---------- >03/25/14 14:04:28 Phase 1: Obtaining ads from collector ... >03/25/14 14:04:28 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:04:28 Trying to query collector <IP:9618> >03/25/14 14:04:28 Sorting 32 ads ... >03/25/14 14:04:28 Getting startd private ads ... >03/25/14 14:04:28 Trying to query collector <IP:9618> >03/25/14 14:04:28 Got ads: 32 public and 30 private >03/25/14 14:04:28 Public ads include 1 submitter, 30 startd >03/25/14 14:04:28 Phase 2: Performing accounting ... >03/25/14 14:04:28 Entering compute_significant_attrs() >03/25/14 14:04:28 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:04:28 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:04:28 CustomerName=Customer.<none> , Old Priority=0.685 , New Priority=0.690 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=24135.000 (unweighted 24135.000), BeginUsageTime=1395751882 >03/25/14 14:04:28 CustomerName=Customer.test@<hostname> , Old Priority=0.685 , New Priority=0.690 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:28 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=24135.000 (unweighted 24135.000), BeginUsageTime=1395751882 >03/25/14 14:04:28 (Accountant) Checking Matches >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:04:28 Match already existed! >03/25/14 14:04:28 Previous Limits -- >03/25/14 14:04:28 Limit: test = 3.000000 >03/25/14 14:04:28 Limit: small.test = 2.000000 >03/25/14 14:04:28 Limit: medium.test = 5.000000 >03/25/14 14:04:28 Limit: undef.test = 1.000000 >03/25/14 14:04:28 Limit: undef = 1.000000 >03/25/14 14:04:28 Limit: large.test = 13.000000 >03/25/14 14:04:28 Limit: medium.undef = 5.000000 >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(medium.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(medium.undef) >03/25/14 14:04:28 IncrementLimit(small.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(medium.undef) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(medium.undef) >03/25/14 14:04:28 IncrementLimit(medium.undef) >03/25/14 14:04:28 IncrementLimit(medium.undef) >03/25/14 14:04:28 IncrementLimit(small.test) >03/25/14 14:04:28 IncrementLimit(test) >03/25/14 14:04:28 IncrementLimit(medium.test) >03/25/14 14:04:28 IncrementLimit(test) >03/25/14 14:04:28 IncrementLimit(medium.test) >03/25/14 14:04:28 IncrementLimit(test) >03/25/14 14:04:28 IncrementLimit(medium.test) >03/25/14 14:04:28 IncrementLimit(undef.test) >03/25/14 14:04:28 IncrementLimit(medium.test) >03/25/14 14:04:28 IncrementLimit(undef) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 IncrementLimit(large.test) >03/25/14 14:04:28 Current Limits -- >03/25/14 14:04:28 Limit: test = 3.000000 >03/25/14 14:04:28 Limit: small.test = 2.000000 >03/25/14 14:04:28 Limit: medium.test = 5.000000 >03/25/14 14:04:28 Limit: undef.test = 1.000000 >03/25/14 14:04:28 Limit: undef = 1.000000 >03/25/14 14:04:28 Limit: large.test = 13.000000 >03/25/14 14:04:28 Limit: medium.undef = 5.000000 >03/25/14 14:04:28 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:04:28 Phase 4.1: Negotiating with schedds ... >03/25/14 14:04:28 numSlots = 30 >03/25/14 14:04:28 slotWeightTotal = 30.000000 >03/25/14 14:04:28 pieLeft = 0.000 >03/25/14 14:04:28 NormalFactor = 1.000000 >03/25/14 14:04:28 MaxPrioValue = 0.689784 >03/25/14 14:04:28 NumSubmitterAds = 1 >03/25/14 14:04:28 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:04:28 0 seconds so far >03/25/14 14:04:28 Calculating submitter limit with the following parameters >03/25/14 14:04:28 SubmitterPrio = 0.689784 >03/25/14 14:04:28 SubmitterPrioFactor = 1.000000 >03/25/14 14:04:28 submitterShare = 1.000000 >03/25/14 14:04:28 submitterAbsShare = 1.000000 >03/25/14 14:04:28 submitterLimit = 0.000000 >03/25/14 14:04:28 submitterUsage = 30.000000 >03/25/14 14:04:28 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:04:28 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00011: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: large.test is 13.000000 >03/25/14 14:04:28 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:04:28 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00025: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:04:28 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:28 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00042: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: small.test is 2.000000 >03/25/14 14:04:28 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:04:28 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00063: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: test is 3.000000 >03/25/14 14:04:28 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:04:28 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00081: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:04:28 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:28 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00101: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: undef is 1.000000 >03/25/14 14:04:28 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:28 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:28 Request 00001.00125: >03/25/14 14:04:28 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:28 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:04:28 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:28 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:04:28 Sending SEND_JOB_INFO/eom >03/25/14 14:04:28 Getting reply from schedd ... >03/25/14 14:04:28 Got NO_MORE_JOBS; done negotiating >03/25/14 14:04:28 This submitter hit its submitterLimit. >03/25/14 14:04:28 resources used scheddUsed= 30.000000 >03/25/14 14:04:28 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:04:28 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:04:28 Getting monitoring info for pid 22893 >03/25/14 14:04:29 Getting monitoring info for pid 22893 >03/25/14 14:04:30 Getting monitoring info for pid 22893 >03/25/14 14:04:31 Getting monitoring info for pid 22893 >03/25/14 14:04:32 Getting monitoring info for pid 22893 >03/25/14 14:04:33 Getting monitoring info for pid 22893 >03/25/14 14:04:34 Getting monitoring info for pid 22893 >03/25/14 14:04:35 Getting monitoring info for pid 22893 >03/25/14 14:04:36 Getting monitoring info for pid 22893 >03/25/14 14:04:37 Getting monitoring info for pid 22893 >03/25/14 14:04:38 Getting monitoring info for pid 22893 >03/25/14 14:04:39 Getting monitoring info for pid 22893 >03/25/14 14:04:40 Getting monitoring info for pid 22893 >03/25/14 14:04:41 Getting monitoring info for pid 22893 >03/25/14 14:04:42 Getting monitoring info for pid 22893 >03/25/14 14:04:43 Getting monitoring info for pid 22893 >03/25/14 14:04:44 Getting monitoring info for pid 22893 >03/25/14 14:04:45 Getting monitoring info for pid 22893 >03/25/14 14:04:46 Getting monitoring info for pid 22893 >03/25/14 14:04:47 Getting monitoring info for pid 22893 >03/25/14 14:04:48 ---------- Started Negotiation Cycle ---------- >03/25/14 14:04:48 Phase 1: Obtaining ads from collector ... >03/25/14 14:04:48 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:04:48 Trying to query collector <IP:9618> >03/25/14 14:04:48 Sorting 32 ads ... >03/25/14 14:04:48 Getting startd private ads ... >03/25/14 14:04:48 Trying to query collector <IP:9618> >03/25/14 14:04:48 Got ads: 32 public and 30 private >03/25/14 14:04:48 Public ads include 1 submitter, 30 startd >03/25/14 14:04:48 Phase 2: Performing accounting ... >03/25/14 14:04:48 Entering compute_significant_attrs() >03/25/14 14:04:48 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:04:48 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:04:48 CustomerName=Customer.<none> , Old Priority=0.690 , New Priority=0.694 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=24735.000 (unweighted 24735.000), BeginUsageTime=1395751882 >03/25/14 14:04:48 CustomerName=Customer.test@<hostname> , Old Priority=0.690 , New Priority=0.694 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:04:48 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=24735.000 (unweighted 24735.000), BeginUsageTime=1395751882 >03/25/14 14:04:48 (Accountant) Checking Matches >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:04:48 Match already existed! >03/25/14 14:04:48 Previous Limits -- >03/25/14 14:04:48 Limit: test = 3.000000 >03/25/14 14:04:48 Limit: small.test = 2.000000 >03/25/14 14:04:48 Limit: medium.test = 5.000000 >03/25/14 14:04:48 Limit: undef.test = 1.000000 >03/25/14 14:04:48 Limit: undef = 1.000000 >03/25/14 14:04:48 Limit: large.test = 13.000000 >03/25/14 14:04:48 Limit: medium.undef = 5.000000 >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(medium.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(medium.undef) >03/25/14 14:04:48 IncrementLimit(small.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(medium.undef) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(medium.undef) >03/25/14 14:04:48 IncrementLimit(medium.undef) >03/25/14 14:04:48 IncrementLimit(medium.undef) >03/25/14 14:04:48 IncrementLimit(small.test) >03/25/14 14:04:48 IncrementLimit(test) >03/25/14 14:04:48 IncrementLimit(medium.test) >03/25/14 14:04:48 IncrementLimit(test) >03/25/14 14:04:48 IncrementLimit(medium.test) >03/25/14 14:04:48 IncrementLimit(test) >03/25/14 14:04:48 IncrementLimit(medium.test) >03/25/14 14:04:48 IncrementLimit(undef.test) >03/25/14 14:04:48 IncrementLimit(medium.test) >03/25/14 14:04:48 IncrementLimit(undef) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 IncrementLimit(large.test) >03/25/14 14:04:48 Current Limits -- >03/25/14 14:04:48 Limit: test = 3.000000 >03/25/14 14:04:48 Limit: small.test = 2.000000 >03/25/14 14:04:48 Limit: medium.test = 5.000000 >03/25/14 14:04:48 Limit: undef.test = 1.000000 >03/25/14 14:04:48 Limit: undef = 1.000000 >03/25/14 14:04:48 Limit: large.test = 13.000000 >03/25/14 14:04:48 Limit: medium.undef = 5.000000 >03/25/14 14:04:49 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:04:49 Phase 4.1: Negotiating with schedds ... >03/25/14 14:04:49 numSlots = 30 >03/25/14 14:04:49 slotWeightTotal = 30.000000 >03/25/14 14:04:49 pieLeft = 0.000 >03/25/14 14:04:49 NormalFactor = 1.000000 >03/25/14 14:04:49 MaxPrioValue = 0.694487 >03/25/14 14:04:49 NumSubmitterAds = 1 >03/25/14 14:04:49 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:04:49 0 seconds so far >03/25/14 14:04:49 Calculating submitter limit with the following parameters >03/25/14 14:04:49 SubmitterPrio = 0.694487 >03/25/14 14:04:49 SubmitterPrioFactor = 1.000000 >03/25/14 14:04:49 submitterShare = 1.000000 >03/25/14 14:04:49 submitterAbsShare = 1.000000 >03/25/14 14:04:49 submitterLimit = 0.000000 >03/25/14 14:04:49 submitterUsage = 30.000000 >03/25/14 14:04:49 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:04:49 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00011: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: large.test is 13.000000 >03/25/14 14:04:49 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:04:49 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00025: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:04:49 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:49 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00042: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: small.test is 2.000000 >03/25/14 14:04:49 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:04:49 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00063: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: test is 3.000000 >03/25/14 14:04:49 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:04:49 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00081: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:04:49 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:49 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00101: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: undef is 1.000000 >03/25/14 14:04:49 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:04:49 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:04:49 Request 00001.00125: >03/25/14 14:04:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:04:49 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:04:49 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:04:49 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:04:49 Sending SEND_JOB_INFO/eom >03/25/14 14:04:49 Getting reply from schedd ... >03/25/14 14:04:49 Got NO_MORE_JOBS; done negotiating >03/25/14 14:04:49 This submitter hit its submitterLimit. >03/25/14 14:04:49 resources used scheddUsed= 30.000000 >03/25/14 14:04:49 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:04:49 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:04:49 Getting monitoring info for pid 22893 >03/25/14 14:04:50 Getting monitoring info for pid 22893 >03/25/14 14:04:51 Getting monitoring info for pid 22893 >03/25/14 14:04:52 Getting monitoring info for pid 22893 >03/25/14 14:04:53 Getting monitoring info for pid 22893 >03/25/14 14:04:54 Getting monitoring info for pid 22893 >03/25/14 14:04:55 Getting monitoring info for pid 22893 >03/25/14 14:04:56 Getting monitoring info for pid 22893 >03/25/14 14:04:57 Getting monitoring info for pid 22893 >03/25/14 14:04:58 Getting monitoring info for pid 22893 >03/25/14 14:04:59 Getting monitoring info for pid 22893 >03/25/14 14:05:00 Getting monitoring info for pid 22893 >03/25/14 14:05:01 Getting monitoring info for pid 22893 >03/25/14 14:05:02 Getting monitoring info for pid 22893 >03/25/14 14:05:03 Getting monitoring info for pid 22893 >03/25/14 14:05:04 Getting monitoring info for pid 22893 >03/25/14 14:05:05 Getting monitoring info for pid 22893 >03/25/14 14:05:06 Getting monitoring info for pid 22893 >03/25/14 14:05:07 Getting monitoring info for pid 22893 >03/25/14 14:05:08 Getting monitoring info for pid 22893 >03/25/14 14:05:09 ---------- Started Negotiation Cycle ---------- >03/25/14 14:05:09 Phase 1: Obtaining ads from collector ... >03/25/14 14:05:09 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:05:09 Trying to query collector <IP:9618> >03/25/14 14:05:09 Sorting 32 ads ... >03/25/14 14:05:09 Getting startd private ads ... >03/25/14 14:05:09 Trying to query collector <IP:9618> >03/25/14 14:05:09 Got ads: 32 public and 30 private >03/25/14 14:05:09 Public ads include 1 submitter, 30 startd >03/25/14 14:05:09 Phase 2: Performing accounting ... >03/25/14 14:05:09 Entering compute_significant_attrs() >03/25/14 14:05:09 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:05:09 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:05:09 CustomerName=Customer.<none> , Old Priority=0.694 , New Priority=0.699 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:09 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=25365.000 (unweighted 25365.000), BeginUsageTime=1395751882 >03/25/14 14:05:09 CustomerName=Customer.test@<hostname> , Old Priority=0.694 , New Priority=0.699 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:09 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=25365.000 (unweighted 25365.000), BeginUsageTime=1395751882 >03/25/14 14:05:09 (Accountant) Checking Matches >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:05:09 Match already existed! >03/25/14 14:05:09 Previous Limits -- >03/25/14 14:05:09 Limit: test = 3.000000 >03/25/14 14:05:09 Limit: small.test = 2.000000 >03/25/14 14:05:09 Limit: medium.test = 5.000000 >03/25/14 14:05:09 Limit: undef.test = 1.000000 >03/25/14 14:05:09 Limit: undef = 1.000000 >03/25/14 14:05:09 Limit: large.test = 13.000000 >03/25/14 14:05:09 Limit: medium.undef = 5.000000 >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(medium.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(medium.undef) >03/25/14 14:05:09 IncrementLimit(small.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(medium.undef) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(medium.undef) >03/25/14 14:05:09 IncrementLimit(medium.undef) >03/25/14 14:05:09 IncrementLimit(medium.undef) >03/25/14 14:05:09 IncrementLimit(small.test) >03/25/14 14:05:09 IncrementLimit(test) >03/25/14 14:05:09 IncrementLimit(medium.test) >03/25/14 14:05:09 IncrementLimit(test) >03/25/14 14:05:09 IncrementLimit(medium.test) >03/25/14 14:05:09 IncrementLimit(test) >03/25/14 14:05:09 IncrementLimit(medium.test) >03/25/14 14:05:09 IncrementLimit(undef.test) >03/25/14 14:05:09 IncrementLimit(medium.test) >03/25/14 14:05:09 IncrementLimit(undef) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 IncrementLimit(large.test) >03/25/14 14:05:09 Current Limits -- >03/25/14 14:05:09 Limit: test = 3.000000 >03/25/14 14:05:09 Limit: small.test = 2.000000 >03/25/14 14:05:09 Limit: medium.test = 5.000000 >03/25/14 14:05:09 Limit: undef.test = 1.000000 >03/25/14 14:05:09 Limit: undef = 1.000000 >03/25/14 14:05:09 Limit: large.test = 13.000000 >03/25/14 14:05:09 Limit: medium.undef = 5.000000 >03/25/14 14:05:09 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:05:09 Phase 4.1: Negotiating with schedds ... >03/25/14 14:05:09 numSlots = 30 >03/25/14 14:05:09 slotWeightTotal = 30.000000 >03/25/14 14:05:09 pieLeft = 0.000 >03/25/14 14:05:09 NormalFactor = 1.000000 >03/25/14 14:05:09 MaxPrioValue = 0.699423 >03/25/14 14:05:09 NumSubmitterAds = 1 >03/25/14 14:05:09 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:05:09 0 seconds so far >03/25/14 14:05:09 Calculating submitter limit with the following parameters >03/25/14 14:05:09 SubmitterPrio = 0.699423 >03/25/14 14:05:09 SubmitterPrioFactor = 1.000000 >03/25/14 14:05:09 submitterShare = 1.000000 >03/25/14 14:05:09 submitterAbsShare = 1.000000 >03/25/14 14:05:09 submitterLimit = 0.000000 >03/25/14 14:05:09 submitterUsage = 30.000000 >03/25/14 14:05:09 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:05:09 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00011: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: large.test is 13.000000 >03/25/14 14:05:09 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:05:09 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00025: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:05:09 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:09 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00042: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: small.test is 2.000000 >03/25/14 14:05:09 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:05:09 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00063: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: test is 3.000000 >03/25/14 14:05:09 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:05:09 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00081: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:05:09 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:09 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00101: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: undef is 1.000000 >03/25/14 14:05:09 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:09 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:09 Request 00001.00125: >03/25/14 14:05:09 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:09 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:05:09 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:09 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:05:09 Sending SEND_JOB_INFO/eom >03/25/14 14:05:09 Getting reply from schedd ... >03/25/14 14:05:09 Got NO_MORE_JOBS; done negotiating >03/25/14 14:05:09 This submitter hit its submitterLimit. >03/25/14 14:05:09 resources used scheddUsed= 30.000000 >03/25/14 14:05:09 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:05:09 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:05:09 Getting monitoring info for pid 22893 >03/25/14 14:05:10 Getting monitoring info for pid 22893 >03/25/14 14:05:11 Getting monitoring info for pid 22893 >03/25/14 14:05:12 Getting monitoring info for pid 22893 >03/25/14 14:05:13 Getting monitoring info for pid 22893 >03/25/14 14:05:14 Getting monitoring info for pid 22893 >03/25/14 14:05:15 Getting monitoring info for pid 22893 >03/25/14 14:05:16 Getting monitoring info for pid 22893 >03/25/14 14:05:17 Getting monitoring info for pid 22893 >03/25/14 14:05:18 Getting monitoring info for pid 22893 >03/25/14 14:05:19 Getting monitoring info for pid 22893 >03/25/14 14:05:20 Getting monitoring info for pid 22893 >03/25/14 14:05:21 Getting monitoring info for pid 22893 >03/25/14 14:05:22 Getting monitoring info for pid 22893 >03/25/14 14:05:23 Getting monitoring info for pid 22893 >03/25/14 14:05:24 Getting monitoring info for pid 22893 >03/25/14 14:05:25 Getting monitoring info for pid 22893 >03/25/14 14:05:26 Getting monitoring info for pid 22893 >03/25/14 14:05:27 Getting monitoring info for pid 22893 >03/25/14 14:05:28 Getting monitoring info for pid 22893 >03/25/14 14:05:29 ---------- Started Negotiation Cycle ---------- >03/25/14 14:05:29 Phase 1: Obtaining ads from collector ... >03/25/14 14:05:29 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:05:29 Trying to query collector <IP:9618> >03/25/14 14:05:29 Sorting 32 ads ... >03/25/14 14:05:29 Getting startd private ads ... >03/25/14 14:05:29 Trying to query collector <IP:9618> >03/25/14 14:05:29 Got ads: 32 public and 30 private >03/25/14 14:05:29 Public ads include 1 submitter, 30 startd >03/25/14 14:05:29 Phase 2: Performing accounting ... >03/25/14 14:05:29 Entering compute_significant_attrs() >03/25/14 14:05:29 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:05:29 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:05:29 CustomerName=Customer.<none> , Old Priority=0.699 , New Priority=0.704 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:29 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=25965.000 (unweighted 25965.000), BeginUsageTime=1395751882 >03/25/14 14:05:29 CustomerName=Customer.test@<hostname> , Old Priority=0.699 , New Priority=0.704 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:29 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=25965.000 (unweighted 25965.000), BeginUsageTime=1395751882 >03/25/14 14:05:29 (Accountant) Checking Matches >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:05:29 Match already existed! >03/25/14 14:05:29 Previous Limits -- >03/25/14 14:05:29 Limit: test = 3.000000 >03/25/14 14:05:29 Limit: small.test = 2.000000 >03/25/14 14:05:29 Limit: medium.test = 5.000000 >03/25/14 14:05:29 Limit: undef.test = 1.000000 >03/25/14 14:05:29 Limit: undef = 1.000000 >03/25/14 14:05:29 Limit: large.test = 13.000000 >03/25/14 14:05:29 Limit: medium.undef = 5.000000 >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(medium.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(medium.undef) >03/25/14 14:05:29 IncrementLimit(small.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(medium.undef) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(medium.undef) >03/25/14 14:05:29 IncrementLimit(medium.undef) >03/25/14 14:05:29 IncrementLimit(medium.undef) >03/25/14 14:05:29 IncrementLimit(small.test) >03/25/14 14:05:29 IncrementLimit(test) >03/25/14 14:05:29 IncrementLimit(medium.test) >03/25/14 14:05:29 IncrementLimit(test) >03/25/14 14:05:29 IncrementLimit(medium.test) >03/25/14 14:05:29 IncrementLimit(test) >03/25/14 14:05:29 IncrementLimit(medium.test) >03/25/14 14:05:29 IncrementLimit(undef.test) >03/25/14 14:05:29 IncrementLimit(medium.test) >03/25/14 14:05:29 IncrementLimit(undef) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 IncrementLimit(large.test) >03/25/14 14:05:29 Current Limits -- >03/25/14 14:05:29 Limit: test = 3.000000 >03/25/14 14:05:29 Limit: small.test = 2.000000 >03/25/14 14:05:29 Limit: medium.test = 5.000000 >03/25/14 14:05:29 Limit: undef.test = 1.000000 >03/25/14 14:05:29 Limit: undef = 1.000000 >03/25/14 14:05:29 Limit: large.test = 13.000000 >03/25/14 14:05:29 Limit: medium.undef = 5.000000 >03/25/14 14:05:29 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:05:29 Phase 4.1: Negotiating with schedds ... >03/25/14 14:05:29 numSlots = 30 >03/25/14 14:05:29 slotWeightTotal = 30.000000 >03/25/14 14:05:29 pieLeft = 0.000 >03/25/14 14:05:29 NormalFactor = 1.000000 >03/25/14 14:05:29 MaxPrioValue = 0.704124 >03/25/14 14:05:29 NumSubmitterAds = 1 >03/25/14 14:05:29 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:05:29 0 seconds so far >03/25/14 14:05:29 Calculating submitter limit with the following parameters >03/25/14 14:05:29 SubmitterPrio = 0.704124 >03/25/14 14:05:29 SubmitterPrioFactor = 1.000000 >03/25/14 14:05:29 submitterShare = 1.000000 >03/25/14 14:05:29 submitterAbsShare = 1.000000 >03/25/14 14:05:29 submitterLimit = 0.000000 >03/25/14 14:05:29 submitterUsage = 30.000000 >03/25/14 14:05:29 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:05:29 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00011: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: large.test is 13.000000 >03/25/14 14:05:29 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:05:29 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00025: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:05:29 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:29 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00042: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: small.test is 2.000000 >03/25/14 14:05:29 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:05:29 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00063: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: test is 3.000000 >03/25/14 14:05:29 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:05:29 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00081: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:05:29 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:29 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00101: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: undef is 1.000000 >03/25/14 14:05:29 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:29 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:29 Request 00001.00125: >03/25/14 14:05:29 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:29 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:05:29 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:29 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:05:29 Sending SEND_JOB_INFO/eom >03/25/14 14:05:29 Getting reply from schedd ... >03/25/14 14:05:29 Got NO_MORE_JOBS; done negotiating >03/25/14 14:05:29 This submitter hit its submitterLimit. >03/25/14 14:05:29 resources used scheddUsed= 30.000000 >03/25/14 14:05:29 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:05:29 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:05:29 Getting monitoring info for pid 22893 >03/25/14 14:05:30 enter Matchmaker::updateCollector >03/25/14 14:05:30 Warning: Could not find DaemonStartTime >03/25/14 14:05:30 Trying to update collector <IP:9618> >03/25/14 14:05:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:05:30 exit Matchmaker::UpdateCollector >03/25/14 14:05:30 Getting monitoring info for pid 22893 >03/25/14 14:05:31 Getting monitoring info for pid 22893 >03/25/14 14:05:32 Getting monitoring info for pid 22893 >03/25/14 14:05:33 Getting monitoring info for pid 22893 >03/25/14 14:05:34 Getting monitoring info for pid 22893 >03/25/14 14:05:35 Getting monitoring info for pid 22893 >03/25/14 14:05:36 Getting monitoring info for pid 22893 >03/25/14 14:05:37 Getting monitoring info for pid 22893 >03/25/14 14:05:38 Getting monitoring info for pid 22893 >03/25/14 14:05:39 Getting monitoring info for pid 22893 >03/25/14 14:05:40 Getting monitoring info for pid 22893 >03/25/14 14:05:41 Getting monitoring info for pid 22893 >03/25/14 14:05:42 Getting monitoring info for pid 22893 >03/25/14 14:05:43 Getting monitoring info for pid 22893 >03/25/14 14:05:44 Getting monitoring info for pid 22893 >03/25/14 14:05:45 Getting monitoring info for pid 22893 >03/25/14 14:05:46 Getting monitoring info for pid 22893 >03/25/14 14:05:47 Getting monitoring info for pid 22893 >03/25/14 14:05:48 Getting monitoring info for pid 22893 >03/25/14 14:05:49 ---------- Started Negotiation Cycle ---------- >03/25/14 14:05:49 Phase 1: Obtaining ads from collector ... >03/25/14 14:05:49 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:05:49 Trying to query collector <IP:9618> >03/25/14 14:05:49 Sorting 32 ads ... >03/25/14 14:05:49 Getting startd private ads ... >03/25/14 14:05:49 Trying to query collector <IP:9618> >03/25/14 14:05:49 Got ads: 32 public and 30 private >03/25/14 14:05:49 Public ads include 1 submitter, 30 startd >03/25/14 14:05:49 Phase 2: Performing accounting ... >03/25/14 14:05:49 Entering compute_significant_attrs() >03/25/14 14:05:49 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:05:49 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:05:49 CustomerName=Customer.<none> , Old Priority=0.704 , New Priority=0.709 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:49 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=26565.000 (unweighted 26565.000), BeginUsageTime=1395751882 >03/25/14 14:05:49 CustomerName=Customer.test@<hostname> , Old Priority=0.704 , New Priority=0.709 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:05:49 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=26565.000 (unweighted 26565.000), BeginUsageTime=1395751882 >03/25/14 14:05:49 (Accountant) Checking Matches >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:05:49 Match already existed! >03/25/14 14:05:49 Previous Limits -- >03/25/14 14:05:49 Limit: test = 3.000000 >03/25/14 14:05:49 Limit: small.test = 2.000000 >03/25/14 14:05:49 Limit: medium.test = 5.000000 >03/25/14 14:05:49 Limit: undef.test = 1.000000 >03/25/14 14:05:49 Limit: undef = 1.000000 >03/25/14 14:05:49 Limit: large.test = 13.000000 >03/25/14 14:05:49 Limit: medium.undef = 5.000000 >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(medium.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(small.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(medium.undef) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(medium.undef) >03/25/14 14:05:49 IncrementLimit(medium.undef) >03/25/14 14:05:49 IncrementLimit(medium.undef) >03/25/14 14:05:49 IncrementLimit(small.test) >03/25/14 14:05:49 IncrementLimit(medium.undef) >03/25/14 14:05:49 IncrementLimit(test) >03/25/14 14:05:49 IncrementLimit(medium.test) >03/25/14 14:05:49 IncrementLimit(test) >03/25/14 14:05:49 IncrementLimit(medium.test) >03/25/14 14:05:49 IncrementLimit(test) >03/25/14 14:05:49 IncrementLimit(medium.test) >03/25/14 14:05:49 IncrementLimit(undef.test) >03/25/14 14:05:49 IncrementLimit(medium.test) >03/25/14 14:05:49 IncrementLimit(undef) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 IncrementLimit(large.test) >03/25/14 14:05:49 Current Limits -- >03/25/14 14:05:49 Limit: test = 3.000000 >03/25/14 14:05:49 Limit: small.test = 2.000000 >03/25/14 14:05:49 Limit: medium.test = 5.000000 >03/25/14 14:05:49 Limit: undef.test = 1.000000 >03/25/14 14:05:49 Limit: undef = 1.000000 >03/25/14 14:05:49 Limit: large.test = 13.000000 >03/25/14 14:05:49 Limit: medium.undef = 5.000000 >03/25/14 14:05:49 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:05:49 Phase 4.1: Negotiating with schedds ... >03/25/14 14:05:49 numSlots = 30 >03/25/14 14:05:49 slotWeightTotal = 30.000000 >03/25/14 14:05:49 pieLeft = 0.000 >03/25/14 14:05:49 NormalFactor = 1.000000 >03/25/14 14:05:49 MaxPrioValue = 0.708825 >03/25/14 14:05:49 NumSubmitterAds = 1 >03/25/14 14:05:49 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:05:49 0 seconds so far >03/25/14 14:05:49 Calculating submitter limit with the following parameters >03/25/14 14:05:49 SubmitterPrio = 0.708825 >03/25/14 14:05:49 SubmitterPrioFactor = 1.000000 >03/25/14 14:05:49 submitterShare = 1.000000 >03/25/14 14:05:49 submitterAbsShare = 1.000000 >03/25/14 14:05:49 submitterLimit = 0.000000 >03/25/14 14:05:49 submitterUsage = 30.000000 >03/25/14 14:05:49 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:05:49 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00011: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: large.test is 13.000000 >03/25/14 14:05:49 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:05:49 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00025: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:05:49 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:49 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00042: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: small.test is 2.000000 >03/25/14 14:05:49 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:05:49 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00063: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: test is 3.000000 >03/25/14 14:05:49 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:05:49 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00081: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:05:49 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:49 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00101: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: undef is 1.000000 >03/25/14 14:05:49 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:05:49 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got JOB_INFO command; getting classad/eom >03/25/14 14:05:49 Request 00001.00125: >03/25/14 14:05:49 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:05:49 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:05:49 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:05:49 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:05:49 Sending SEND_JOB_INFO/eom >03/25/14 14:05:49 Getting reply from schedd ... >03/25/14 14:05:49 Got NO_MORE_JOBS; done negotiating >03/25/14 14:05:49 This submitter hit its submitterLimit. >03/25/14 14:05:49 resources used scheddUsed= 30.000000 >03/25/14 14:05:49 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:05:49 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:05:49 Getting monitoring info for pid 22893 >03/25/14 14:05:50 Getting monitoring info for pid 22893 >03/25/14 14:05:51 Getting monitoring info for pid 22893 >03/25/14 14:05:52 Getting monitoring info for pid 22893 >03/25/14 14:05:53 Getting monitoring info for pid 22893 >03/25/14 14:05:54 Getting monitoring info for pid 22893 >03/25/14 14:05:55 Getting monitoring info for pid 22893 >03/25/14 14:05:56 Getting monitoring info for pid 22893 >03/25/14 14:05:57 Getting monitoring info for pid 22893 >03/25/14 14:05:58 Getting monitoring info for pid 22893 >03/25/14 14:05:59 Getting monitoring info for pid 22893 >03/25/14 14:06:00 Getting monitoring info for pid 22893 >03/25/14 14:06:01 Getting monitoring info for pid 22893 >03/25/14 14:06:02 Getting monitoring info for pid 22893 >03/25/14 14:06:03 Getting monitoring info for pid 22893 >03/25/14 14:06:04 Getting monitoring info for pid 22893 >03/25/14 14:06:05 Getting monitoring info for pid 22893 >03/25/14 14:06:06 Getting monitoring info for pid 22893 >03/25/14 14:06:07 Getting monitoring info for pid 22893 >03/25/14 14:06:08 Getting monitoring info for pid 22893 >03/25/14 14:06:09 ---------- Started Negotiation Cycle ---------- >03/25/14 14:06:09 Phase 1: Obtaining ads from collector ... >03/25/14 14:06:09 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:06:09 Trying to query collector <IP:9618> >03/25/14 14:06:09 Sorting 32 ads ... >03/25/14 14:06:09 Getting startd private ads ... >03/25/14 14:06:09 Trying to query collector <IP:9618> >03/25/14 14:06:09 Got ads: 32 public and 30 private >03/25/14 14:06:09 Public ads include 1 submitter, 30 startd >03/25/14 14:06:09 Phase 2: Performing accounting ... >03/25/14 14:06:09 Entering compute_significant_attrs() >03/25/14 14:06:09 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:06:10 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:06:10 CustomerName=Customer.<none> , Old Priority=0.709 , New Priority=0.714 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:10 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=27165.000 (unweighted 27165.000), BeginUsageTime=1395751882 >03/25/14 14:06:10 CustomerName=Customer.test@<hostname> , Old Priority=0.709 , New Priority=0.714 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:10 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=27165.000 (unweighted 27165.000), BeginUsageTime=1395751882 >03/25/14 14:06:10 (Accountant) Checking Matches >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:06:10 Match already existed! >03/25/14 14:06:10 Previous Limits -- >03/25/14 14:06:10 Limit: test = 3.000000 >03/25/14 14:06:10 Limit: small.test = 2.000000 >03/25/14 14:06:10 Limit: medium.test = 5.000000 >03/25/14 14:06:10 Limit: undef.test = 1.000000 >03/25/14 14:06:10 Limit: undef = 1.000000 >03/25/14 14:06:10 Limit: large.test = 13.000000 >03/25/14 14:06:10 Limit: medium.undef = 5.000000 >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(medium.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(medium.undef) >03/25/14 14:06:10 IncrementLimit(small.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(medium.undef) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(medium.undef) >03/25/14 14:06:10 IncrementLimit(medium.undef) >03/25/14 14:06:10 IncrementLimit(medium.undef) >03/25/14 14:06:10 IncrementLimit(small.test) >03/25/14 14:06:10 IncrementLimit(test) >03/25/14 14:06:10 IncrementLimit(medium.test) >03/25/14 14:06:10 IncrementLimit(test) >03/25/14 14:06:10 IncrementLimit(medium.test) >03/25/14 14:06:10 IncrementLimit(test) >03/25/14 14:06:10 IncrementLimit(medium.test) >03/25/14 14:06:10 IncrementLimit(undef.test) >03/25/14 14:06:10 IncrementLimit(medium.test) >03/25/14 14:06:10 IncrementLimit(undef) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 IncrementLimit(large.test) >03/25/14 14:06:10 Current Limits -- >03/25/14 14:06:10 Limit: test = 3.000000 >03/25/14 14:06:10 Limit: small.test = 2.000000 >03/25/14 14:06:10 Limit: medium.test = 5.000000 >03/25/14 14:06:10 Limit: undef.test = 1.000000 >03/25/14 14:06:10 Limit: undef = 1.000000 >03/25/14 14:06:10 Limit: large.test = 13.000000 >03/25/14 14:06:10 Limit: medium.undef = 5.000000 >03/25/14 14:06:10 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:06:10 Phase 4.1: Negotiating with schedds ... >03/25/14 14:06:10 numSlots = 30 >03/25/14 14:06:10 slotWeightTotal = 30.000000 >03/25/14 14:06:10 pieLeft = 0.000 >03/25/14 14:06:10 NormalFactor = 1.000000 >03/25/14 14:06:10 MaxPrioValue = 0.713525 >03/25/14 14:06:10 NumSubmitterAds = 1 >03/25/14 14:06:10 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:06:10 0 seconds so far >03/25/14 14:06:10 Calculating submitter limit with the following parameters >03/25/14 14:06:10 SubmitterPrio = 0.713525 >03/25/14 14:06:10 SubmitterPrioFactor = 1.000000 >03/25/14 14:06:10 submitterShare = 1.000000 >03/25/14 14:06:10 submitterAbsShare = 1.000000 >03/25/14 14:06:10 submitterLimit = 0.000000 >03/25/14 14:06:10 submitterUsage = 30.000000 >03/25/14 14:06:10 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:06:10 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00011: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: large.test is 13.000000 >03/25/14 14:06:10 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:06:10 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00025: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:06:10 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:10 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00042: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: small.test is 2.000000 >03/25/14 14:06:10 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:06:10 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00063: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: test is 3.000000 >03/25/14 14:06:10 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:06:10 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00081: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:06:10 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:10 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00101: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: undef is 1.000000 >03/25/14 14:06:10 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:10 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:10 Request 00001.00125: >03/25/14 14:06:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:10 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:06:10 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:10 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:06:10 Sending SEND_JOB_INFO/eom >03/25/14 14:06:10 Getting reply from schedd ... >03/25/14 14:06:10 Got NO_MORE_JOBS; done negotiating >03/25/14 14:06:10 This submitter hit its submitterLimit. >03/25/14 14:06:10 resources used scheddUsed= 30.000000 >03/25/14 14:06:10 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:06:10 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:06:10 Getting monitoring info for pid 22893 >03/25/14 14:06:11 Getting monitoring info for pid 22893 >03/25/14 14:06:12 Getting monitoring info for pid 22893 >03/25/14 14:06:13 Getting monitoring info for pid 22893 >03/25/14 14:06:14 Getting monitoring info for pid 22893 >03/25/14 14:06:15 Getting monitoring info for pid 22893 >03/25/14 14:06:16 Getting monitoring info for pid 22893 >03/25/14 14:06:17 Getting monitoring info for pid 22893 >03/25/14 14:06:18 Getting monitoring info for pid 22893 >03/25/14 14:06:19 Getting monitoring info for pid 22893 >03/25/14 14:06:20 Getting monitoring info for pid 22893 >03/25/14 14:06:21 Getting monitoring info for pid 22893 >03/25/14 14:06:22 Getting monitoring info for pid 22893 >03/25/14 14:06:23 Getting monitoring info for pid 22893 >03/25/14 14:06:24 Getting monitoring info for pid 22893 >03/25/14 14:06:25 Getting monitoring info for pid 22893 >03/25/14 14:06:26 Getting monitoring info for pid 22893 >03/25/14 14:06:27 Getting monitoring info for pid 22893 >03/25/14 14:06:28 Getting monitoring info for pid 22893 >03/25/14 14:06:29 Getting monitoring info for pid 22893 >03/25/14 14:06:30 ---------- Started Negotiation Cycle ---------- >03/25/14 14:06:30 Phase 1: Obtaining ads from collector ... >03/25/14 14:06:30 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:06:30 Trying to query collector <IP:9618> >03/25/14 14:06:30 Sorting 32 ads ... >03/25/14 14:06:30 Getting startd private ads ... >03/25/14 14:06:30 Trying to query collector <IP:9618> >03/25/14 14:06:30 Got ads: 32 public and 30 private >03/25/14 14:06:30 Public ads include 1 submitter, 30 startd >03/25/14 14:06:30 Phase 2: Performing accounting ... >03/25/14 14:06:30 Entering compute_significant_attrs() >03/25/14 14:06:30 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:06:30 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:06:30 CustomerName=Customer.<none> , Old Priority=0.714 , New Priority=0.718 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:30 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=27795.000 (unweighted 27795.000), BeginUsageTime=1395751882 >03/25/14 14:06:30 CustomerName=Customer.test@<hostname> , Old Priority=0.714 , New Priority=0.718 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:30 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=27795.000 (unweighted 27795.000), BeginUsageTime=1395751882 >03/25/14 14:06:30 (Accountant) Checking Matches >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:06:30 Match already existed! >03/25/14 14:06:30 Previous Limits -- >03/25/14 14:06:30 Limit: test = 3.000000 >03/25/14 14:06:30 Limit: small.test = 2.000000 >03/25/14 14:06:30 Limit: medium.test = 5.000000 >03/25/14 14:06:30 Limit: undef.test = 1.000000 >03/25/14 14:06:30 Limit: undef = 1.000000 >03/25/14 14:06:30 Limit: large.test = 13.000000 >03/25/14 14:06:30 Limit: medium.undef = 5.000000 >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(medium.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(medium.undef) >03/25/14 14:06:30 IncrementLimit(small.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(medium.undef) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(medium.undef) >03/25/14 14:06:30 IncrementLimit(medium.undef) >03/25/14 14:06:30 IncrementLimit(medium.undef) >03/25/14 14:06:30 IncrementLimit(small.test) >03/25/14 14:06:30 IncrementLimit(test) >03/25/14 14:06:30 IncrementLimit(medium.test) >03/25/14 14:06:30 IncrementLimit(test) >03/25/14 14:06:30 IncrementLimit(medium.test) >03/25/14 14:06:30 IncrementLimit(test) >03/25/14 14:06:30 IncrementLimit(medium.test) >03/25/14 14:06:30 IncrementLimit(undef.test) >03/25/14 14:06:30 IncrementLimit(medium.test) >03/25/14 14:06:30 IncrementLimit(undef) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 IncrementLimit(large.test) >03/25/14 14:06:30 Current Limits -- >03/25/14 14:06:30 Limit: test = 3.000000 >03/25/14 14:06:30 Limit: small.test = 2.000000 >03/25/14 14:06:30 Limit: medium.test = 5.000000 >03/25/14 14:06:30 Limit: undef.test = 1.000000 >03/25/14 14:06:30 Limit: undef = 1.000000 >03/25/14 14:06:30 Limit: large.test = 13.000000 >03/25/14 14:06:30 Limit: medium.undef = 5.000000 >03/25/14 14:06:30 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:06:30 Phase 4.1: Negotiating with schedds ... >03/25/14 14:06:30 numSlots = 30 >03/25/14 14:06:30 slotWeightTotal = 30.000000 >03/25/14 14:06:30 pieLeft = 0.000 >03/25/14 14:06:30 NormalFactor = 1.000000 >03/25/14 14:06:30 MaxPrioValue = 0.718458 >03/25/14 14:06:30 NumSubmitterAds = 1 >03/25/14 14:06:30 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:06:30 0 seconds so far >03/25/14 14:06:30 Calculating submitter limit with the following parameters >03/25/14 14:06:30 SubmitterPrio = 0.718458 >03/25/14 14:06:30 SubmitterPrioFactor = 1.000000 >03/25/14 14:06:30 submitterShare = 1.000000 >03/25/14 14:06:30 submitterAbsShare = 1.000000 >03/25/14 14:06:30 submitterLimit = 0.000000 >03/25/14 14:06:30 submitterUsage = 30.000000 >03/25/14 14:06:30 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:06:30 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00011: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: large.test is 13.000000 >03/25/14 14:06:30 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:06:30 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00025: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:06:30 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:30 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00042: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: small.test is 2.000000 >03/25/14 14:06:30 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:06:30 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00063: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: test is 3.000000 >03/25/14 14:06:30 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:06:30 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00081: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:06:30 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:30 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00101: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: undef is 1.000000 >03/25/14 14:06:30 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:30 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:30 Request 00001.00125: >03/25/14 14:06:30 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:30 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:06:30 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:30 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:06:30 Sending SEND_JOB_INFO/eom >03/25/14 14:06:30 Getting reply from schedd ... >03/25/14 14:06:30 Got NO_MORE_JOBS; done negotiating >03/25/14 14:06:30 This submitter hit its submitterLimit. >03/25/14 14:06:30 resources used scheddUsed= 30.000000 >03/25/14 14:06:30 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:06:30 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:06:30 Getting monitoring info for pid 22893 >03/25/14 14:06:31 Getting monitoring info for pid 22893 >03/25/14 14:06:32 Getting monitoring info for pid 22893 >03/25/14 14:06:33 Getting monitoring info for pid 22893 >03/25/14 14:06:34 Getting monitoring info for pid 22893 >03/25/14 14:06:35 Getting monitoring info for pid 22893 >03/25/14 14:06:36 Getting monitoring info for pid 22893 >03/25/14 14:06:37 Getting monitoring info for pid 22893 >03/25/14 14:06:38 Getting monitoring info for pid 22893 >03/25/14 14:06:39 Getting monitoring info for pid 22893 >03/25/14 14:06:40 Getting monitoring info for pid 22893 >03/25/14 14:06:41 Getting monitoring info for pid 22893 >03/25/14 14:06:42 Getting monitoring info for pid 22893 >03/25/14 14:06:43 Getting monitoring info for pid 22893 >03/25/14 14:06:44 Getting monitoring info for pid 22893 >03/25/14 14:06:45 Getting monitoring info for pid 22893 >03/25/14 14:06:46 Getting monitoring info for pid 22893 >03/25/14 14:06:47 Getting monitoring info for pid 22893 >03/25/14 14:06:48 Getting monitoring info for pid 22893 >03/25/14 14:06:49 Getting monitoring info for pid 22893 >03/25/14 14:06:50 ---------- Started Negotiation Cycle ---------- >03/25/14 14:06:50 Phase 1: Obtaining ads from collector ... >03/25/14 14:06:50 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:06:50 Trying to query collector <IP:9618> >03/25/14 14:06:50 Sorting 32 ads ... >03/25/14 14:06:50 Getting startd private ads ... >03/25/14 14:06:50 Trying to query collector <IP:9618> >03/25/14 14:06:50 Got ads: 32 public and 30 private >03/25/14 14:06:50 Public ads include 1 submitter, 30 startd >03/25/14 14:06:50 Phase 2: Performing accounting ... >03/25/14 14:06:50 Entering compute_significant_attrs() >03/25/14 14:06:50 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:06:50 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:06:50 CustomerName=Customer.<none> , Old Priority=0.718 , New Priority=0.723 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:50 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=28395.000 (unweighted 28395.000), BeginUsageTime=1395751882 >03/25/14 14:06:50 CustomerName=Customer.test@<hostname> , Old Priority=0.718 , New Priority=0.723 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:06:50 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=28395.000 (unweighted 28395.000), BeginUsageTime=1395751882 >03/25/14 14:06:50 (Accountant) Checking Matches >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:06:50 Match already existed! >03/25/14 14:06:50 Previous Limits -- >03/25/14 14:06:50 Limit: test = 3.000000 >03/25/14 14:06:50 Limit: small.test = 2.000000 >03/25/14 14:06:50 Limit: medium.test = 5.000000 >03/25/14 14:06:50 Limit: undef.test = 1.000000 >03/25/14 14:06:50 Limit: undef = 1.000000 >03/25/14 14:06:50 Limit: large.test = 13.000000 >03/25/14 14:06:50 Limit: medium.undef = 5.000000 >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(medium.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(medium.undef) >03/25/14 14:06:50 IncrementLimit(small.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(medium.undef) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(medium.undef) >03/25/14 14:06:50 IncrementLimit(medium.undef) >03/25/14 14:06:50 IncrementLimit(medium.undef) >03/25/14 14:06:50 IncrementLimit(small.test) >03/25/14 14:06:50 IncrementLimit(test) >03/25/14 14:06:50 IncrementLimit(medium.test) >03/25/14 14:06:50 IncrementLimit(test) >03/25/14 14:06:50 IncrementLimit(medium.test) >03/25/14 14:06:50 IncrementLimit(test) >03/25/14 14:06:50 IncrementLimit(medium.test) >03/25/14 14:06:50 IncrementLimit(undef.test) >03/25/14 14:06:50 IncrementLimit(medium.test) >03/25/14 14:06:50 IncrementLimit(undef) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 IncrementLimit(large.test) >03/25/14 14:06:50 Current Limits -- >03/25/14 14:06:50 Limit: test = 3.000000 >03/25/14 14:06:50 Limit: small.test = 2.000000 >03/25/14 14:06:50 Limit: medium.test = 5.000000 >03/25/14 14:06:50 Limit: undef.test = 1.000000 >03/25/14 14:06:50 Limit: undef = 1.000000 >03/25/14 14:06:50 Limit: large.test = 13.000000 >03/25/14 14:06:50 Limit: medium.undef = 5.000000 >03/25/14 14:06:50 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:06:50 Phase 4.1: Negotiating with schedds ... >03/25/14 14:06:50 numSlots = 30 >03/25/14 14:06:50 slotWeightTotal = 30.000000 >03/25/14 14:06:50 pieLeft = 0.000 >03/25/14 14:06:50 NormalFactor = 1.000000 >03/25/14 14:06:50 MaxPrioValue = 0.723156 >03/25/14 14:06:50 NumSubmitterAds = 1 >03/25/14 14:06:50 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:06:50 0 seconds so far >03/25/14 14:06:50 Calculating submitter limit with the following parameters >03/25/14 14:06:50 SubmitterPrio = 0.723156 >03/25/14 14:06:50 SubmitterPrioFactor = 1.000000 >03/25/14 14:06:50 submitterShare = 1.000000 >03/25/14 14:06:50 submitterAbsShare = 1.000000 >03/25/14 14:06:50 submitterLimit = 0.000000 >03/25/14 14:06:50 submitterUsage = 30.000000 >03/25/14 14:06:50 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:06:50 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00011: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: large.test is 13.000000 >03/25/14 14:06:50 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:06:50 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00025: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:06:50 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:50 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00042: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: small.test is 2.000000 >03/25/14 14:06:50 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:06:50 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00063: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: test is 3.000000 >03/25/14 14:06:50 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:06:50 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00081: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:06:50 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:50 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00101: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: undef is 1.000000 >03/25/14 14:06:50 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:06:50 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got JOB_INFO command; getting classad/eom >03/25/14 14:06:50 Request 00001.00125: >03/25/14 14:06:50 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:06:50 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:06:50 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:06:50 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:06:50 Sending SEND_JOB_INFO/eom >03/25/14 14:06:50 Getting reply from schedd ... >03/25/14 14:06:50 Got NO_MORE_JOBS; done negotiating >03/25/14 14:06:50 This submitter hit its submitterLimit. >03/25/14 14:06:50 resources used scheddUsed= 30.000000 >03/25/14 14:06:50 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:06:50 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:06:50 Getting monitoring info for pid 22893 >03/25/14 14:06:51 Getting monitoring info for pid 22893 >03/25/14 14:06:52 Getting monitoring info for pid 22893 >03/25/14 14:06:53 Getting monitoring info for pid 22893 >03/25/14 14:06:54 Getting monitoring info for pid 22893 >03/25/14 14:06:55 Getting monitoring info for pid 22893 >03/25/14 14:06:56 Getting monitoring info for pid 22893 >03/25/14 14:06:57 Getting monitoring info for pid 22893 >03/25/14 14:06:58 Getting monitoring info for pid 22893 >03/25/14 14:06:59 Getting monitoring info for pid 22893 >03/25/14 14:07:00 Getting monitoring info for pid 22893 >03/25/14 14:07:01 Getting monitoring info for pid 22893 >03/25/14 14:07:02 Getting monitoring info for pid 22893 >03/25/14 14:07:03 Getting monitoring info for pid 22893 >03/25/14 14:07:04 Getting monitoring info for pid 22893 >03/25/14 14:07:05 Getting monitoring info for pid 22893 >03/25/14 14:07:06 Getting monitoring info for pid 22893 >03/25/14 14:07:07 Getting monitoring info for pid 22893 >03/25/14 14:07:08 Getting monitoring info for pid 22893 >03/25/14 14:07:09 Getting monitoring info for pid 22893 >03/25/14 14:07:10 ---------- Started Negotiation Cycle ---------- >03/25/14 14:07:10 Phase 1: Obtaining ads from collector ... >03/25/14 14:07:10 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:07:10 Trying to query collector <IP:9618> >03/25/14 14:07:10 Sorting 32 ads ... >03/25/14 14:07:10 Getting startd private ads ... >03/25/14 14:07:10 Trying to query collector <IP:9618> >03/25/14 14:07:10 Got ads: 32 public and 30 private >03/25/14 14:07:10 Public ads include 1 submitter, 30 startd >03/25/14 14:07:10 Phase 2: Performing accounting ... >03/25/14 14:07:10 Entering compute_significant_attrs() >03/25/14 14:07:10 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:07:10 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:07:10 CustomerName=Customer.<none> , Old Priority=0.723 , New Priority=0.728 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:10 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=28995.000 (unweighted 28995.000), BeginUsageTime=1395751882 >03/25/14 14:07:10 CustomerName=Customer.test@<hostname> , Old Priority=0.723 , New Priority=0.728 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:10 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=28995.000 (unweighted 28995.000), BeginUsageTime=1395751882 >03/25/14 14:07:10 (Accountant) Checking Matches >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:07:10 Match already existed! >03/25/14 14:07:10 Previous Limits -- >03/25/14 14:07:10 Limit: test = 3.000000 >03/25/14 14:07:10 Limit: small.test = 2.000000 >03/25/14 14:07:10 Limit: medium.test = 5.000000 >03/25/14 14:07:10 Limit: undef.test = 1.000000 >03/25/14 14:07:10 Limit: undef = 1.000000 >03/25/14 14:07:10 Limit: large.test = 13.000000 >03/25/14 14:07:10 Limit: medium.undef = 5.000000 >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(medium.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(medium.undef) >03/25/14 14:07:10 IncrementLimit(small.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(medium.undef) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(medium.undef) >03/25/14 14:07:10 IncrementLimit(medium.undef) >03/25/14 14:07:10 IncrementLimit(medium.undef) >03/25/14 14:07:10 IncrementLimit(small.test) >03/25/14 14:07:10 IncrementLimit(test) >03/25/14 14:07:10 IncrementLimit(medium.test) >03/25/14 14:07:10 IncrementLimit(test) >03/25/14 14:07:10 IncrementLimit(medium.test) >03/25/14 14:07:10 IncrementLimit(test) >03/25/14 14:07:10 IncrementLimit(medium.test) >03/25/14 14:07:10 IncrementLimit(undef.test) >03/25/14 14:07:10 IncrementLimit(medium.test) >03/25/14 14:07:10 IncrementLimit(undef) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 IncrementLimit(large.test) >03/25/14 14:07:10 Current Limits -- >03/25/14 14:07:10 Limit: test = 3.000000 >03/25/14 14:07:10 Limit: small.test = 2.000000 >03/25/14 14:07:10 Limit: medium.test = 5.000000 >03/25/14 14:07:10 Limit: undef.test = 1.000000 >03/25/14 14:07:10 Limit: undef = 1.000000 >03/25/14 14:07:10 Limit: large.test = 13.000000 >03/25/14 14:07:10 Limit: medium.undef = 5.000000 >03/25/14 14:07:10 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:07:10 Phase 4.1: Negotiating with schedds ... >03/25/14 14:07:10 numSlots = 30 >03/25/14 14:07:10 slotWeightTotal = 30.000000 >03/25/14 14:07:10 pieLeft = 0.000 >03/25/14 14:07:10 NormalFactor = 1.000000 >03/25/14 14:07:10 MaxPrioValue = 0.727854 >03/25/14 14:07:10 NumSubmitterAds = 1 >03/25/14 14:07:10 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:07:10 0 seconds so far >03/25/14 14:07:10 Calculating submitter limit with the following parameters >03/25/14 14:07:10 SubmitterPrio = 0.727854 >03/25/14 14:07:10 SubmitterPrioFactor = 1.000000 >03/25/14 14:07:10 submitterShare = 1.000000 >03/25/14 14:07:10 submitterAbsShare = 1.000000 >03/25/14 14:07:10 submitterLimit = 0.000000 >03/25/14 14:07:10 submitterUsage = 30.000000 >03/25/14 14:07:10 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:07:10 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00011: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: large.test is 13.000000 >03/25/14 14:07:10 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:07:10 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00025: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:07:10 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:10 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00042: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: small.test is 2.000000 >03/25/14 14:07:10 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:07:10 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00063: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: test is 3.000000 >03/25/14 14:07:10 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:07:10 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00081: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:07:10 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:10 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00101: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: undef is 1.000000 >03/25/14 14:07:10 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:10 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:10 Request 00001.00125: >03/25/14 14:07:10 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:10 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:07:10 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:10 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:07:10 Sending SEND_JOB_INFO/eom >03/25/14 14:07:10 Getting reply from schedd ... >03/25/14 14:07:10 Got NO_MORE_JOBS; done negotiating >03/25/14 14:07:10 This submitter hit its submitterLimit. >03/25/14 14:07:10 resources used scheddUsed= 30.000000 >03/25/14 14:07:10 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:07:10 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:07:10 Getting monitoring info for pid 22893 >03/25/14 14:07:11 Getting monitoring info for pid 22893 >03/25/14 14:07:12 Getting monitoring info for pid 22893 >03/25/14 14:07:13 Getting monitoring info for pid 22893 >03/25/14 14:07:14 Getting monitoring info for pid 22893 >03/25/14 14:07:15 Getting monitoring info for pid 22893 >03/25/14 14:07:16 Getting monitoring info for pid 22893 >03/25/14 14:07:17 Getting monitoring info for pid 22893 >03/25/14 14:07:18 Getting monitoring info for pid 22893 >03/25/14 14:07:19 Getting monitoring info for pid 22893 >03/25/14 14:07:20 Getting monitoring info for pid 22893 >03/25/14 14:07:21 Getting monitoring info for pid 22893 >03/25/14 14:07:22 Getting monitoring info for pid 22893 >03/25/14 14:07:23 Getting monitoring info for pid 22893 >03/25/14 14:07:24 Getting monitoring info for pid 22893 >03/25/14 14:07:25 Getting monitoring info for pid 22893 >03/25/14 14:07:26 Getting monitoring info for pid 22893 >03/25/14 14:07:27 Getting monitoring info for pid 22893 >03/25/14 14:07:28 Getting monitoring info for pid 22893 >03/25/14 14:07:29 Getting monitoring info for pid 22893 >03/25/14 14:07:30 ---------- Started Negotiation Cycle ---------- >03/25/14 14:07:30 Phase 1: Obtaining ads from collector ... >03/25/14 14:07:30 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:07:30 Trying to query collector <IP:9618> >03/25/14 14:07:30 Sorting 32 ads ... >03/25/14 14:07:30 Getting startd private ads ... >03/25/14 14:07:30 Trying to query collector <IP:9618> >03/25/14 14:07:30 Got ads: 32 public and 30 private >03/25/14 14:07:30 Public ads include 1 submitter, 30 startd >03/25/14 14:07:30 Phase 2: Performing accounting ... >03/25/14 14:07:30 Entering compute_significant_attrs() >03/25/14 14:07:30 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:07:30 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:07:30 CustomerName=Customer.<none> , Old Priority=0.728 , New Priority=0.733 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:30 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=29595.000 (unweighted 29595.000), BeginUsageTime=1395751882 >03/25/14 14:07:30 CustomerName=Customer.test@<hostname> , Old Priority=0.728 , New Priority=0.733 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:30 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=29595.000 (unweighted 29595.000), BeginUsageTime=1395751882 >03/25/14 14:07:31 (Accountant) Checking Matches >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:07:31 Match already existed! >03/25/14 14:07:31 Previous Limits -- >03/25/14 14:07:31 Limit: test = 3.000000 >03/25/14 14:07:31 Limit: small.test = 2.000000 >03/25/14 14:07:31 Limit: medium.test = 5.000000 >03/25/14 14:07:31 Limit: undef.test = 1.000000 >03/25/14 14:07:31 Limit: undef = 1.000000 >03/25/14 14:07:31 Limit: large.test = 13.000000 >03/25/14 14:07:31 Limit: medium.undef = 5.000000 >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(medium.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(medium.undef) >03/25/14 14:07:31 IncrementLimit(small.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(medium.undef) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(medium.undef) >03/25/14 14:07:31 IncrementLimit(medium.undef) >03/25/14 14:07:31 IncrementLimit(medium.undef) >03/25/14 14:07:31 IncrementLimit(small.test) >03/25/14 14:07:31 IncrementLimit(test) >03/25/14 14:07:31 IncrementLimit(medium.test) >03/25/14 14:07:31 IncrementLimit(test) >03/25/14 14:07:31 IncrementLimit(medium.test) >03/25/14 14:07:31 IncrementLimit(test) >03/25/14 14:07:31 IncrementLimit(medium.test) >03/25/14 14:07:31 IncrementLimit(undef.test) >03/25/14 14:07:31 IncrementLimit(medium.test) >03/25/14 14:07:31 IncrementLimit(undef) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 IncrementLimit(large.test) >03/25/14 14:07:31 Current Limits -- >03/25/14 14:07:31 Limit: test = 3.000000 >03/25/14 14:07:31 Limit: small.test = 2.000000 >03/25/14 14:07:31 Limit: medium.test = 5.000000 >03/25/14 14:07:31 Limit: undef.test = 1.000000 >03/25/14 14:07:31 Limit: undef = 1.000000 >03/25/14 14:07:31 Limit: large.test = 13.000000 >03/25/14 14:07:31 Limit: medium.undef = 5.000000 >03/25/14 14:07:31 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:07:31 Phase 4.1: Negotiating with schedds ... >03/25/14 14:07:31 numSlots = 30 >03/25/14 14:07:31 slotWeightTotal = 30.000000 >03/25/14 14:07:31 pieLeft = 0.000 >03/25/14 14:07:31 NormalFactor = 1.000000 >03/25/14 14:07:31 MaxPrioValue = 0.732551 >03/25/14 14:07:31 NumSubmitterAds = 1 >03/25/14 14:07:31 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:07:31 0 seconds so far >03/25/14 14:07:31 Calculating submitter limit with the following parameters >03/25/14 14:07:31 SubmitterPrio = 0.732551 >03/25/14 14:07:31 SubmitterPrioFactor = 1.000000 >03/25/14 14:07:31 submitterShare = 1.000000 >03/25/14 14:07:31 submitterAbsShare = 1.000000 >03/25/14 14:07:31 submitterLimit = 0.000000 >03/25/14 14:07:31 submitterUsage = 30.000000 >03/25/14 14:07:31 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:07:31 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00011: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: large.test is 13.000000 >03/25/14 14:07:31 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:07:31 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00025: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:07:31 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:31 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00042: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: small.test is 2.000000 >03/25/14 14:07:31 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:07:31 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00063: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: test is 3.000000 >03/25/14 14:07:31 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:07:31 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00081: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:07:31 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:31 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00101: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: undef is 1.000000 >03/25/14 14:07:31 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:31 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:31 Request 00001.00125: >03/25/14 14:07:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:31 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:07:31 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:31 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:07:31 Sending SEND_JOB_INFO/eom >03/25/14 14:07:31 Getting reply from schedd ... >03/25/14 14:07:31 Got NO_MORE_JOBS; done negotiating >03/25/14 14:07:31 This submitter hit its submitterLimit. >03/25/14 14:07:31 resources used scheddUsed= 30.000000 >03/25/14 14:07:31 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:07:31 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:07:31 Getting monitoring info for pid 22893 >03/25/14 14:07:32 Getting monitoring info for pid 22893 >03/25/14 14:07:33 Getting monitoring info for pid 22893 >03/25/14 14:07:34 Getting monitoring info for pid 22893 >03/25/14 14:07:35 Getting monitoring info for pid 22893 >03/25/14 14:07:36 Getting monitoring info for pid 22893 >03/25/14 14:07:37 Getting monitoring info for pid 22893 >03/25/14 14:07:38 Getting monitoring info for pid 22893 >03/25/14 14:07:39 Getting monitoring info for pid 22893 >03/25/14 14:07:40 Getting monitoring info for pid 22893 >03/25/14 14:07:41 Getting monitoring info for pid 22893 >03/25/14 14:07:42 Getting monitoring info for pid 22893 >03/25/14 14:07:43 Getting monitoring info for pid 22893 >03/25/14 14:07:44 Getting monitoring info for pid 22893 >03/25/14 14:07:45 Getting monitoring info for pid 22893 >03/25/14 14:07:46 Getting monitoring info for pid 22893 >03/25/14 14:07:47 Getting monitoring info for pid 22893 >03/25/14 14:07:48 Getting monitoring info for pid 22893 >03/25/14 14:07:49 Getting monitoring info for pid 22893 >03/25/14 14:07:50 Getting monitoring info for pid 22893 >03/25/14 14:07:51 ---------- Started Negotiation Cycle ---------- >03/25/14 14:07:51 Phase 1: Obtaining ads from collector ... >03/25/14 14:07:51 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:07:51 Trying to query collector <IP:9618> >03/25/14 14:07:51 Sorting 32 ads ... >03/25/14 14:07:51 Getting startd private ads ... >03/25/14 14:07:51 Trying to query collector <IP:9618> >03/25/14 14:07:51 Got ads: 32 public and 30 private >03/25/14 14:07:51 Public ads include 1 submitter, 30 startd >03/25/14 14:07:51 Phase 2: Performing accounting ... >03/25/14 14:07:51 Entering compute_significant_attrs() >03/25/14 14:07:51 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:07:51 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:07:51 CustomerName=Customer.<none> , Old Priority=0.733 , New Priority=0.737 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:51 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=30225.000 (unweighted 30225.000), BeginUsageTime=1395751882 >03/25/14 14:07:51 CustomerName=Customer.test@<hostname> , Old Priority=0.733 , New Priority=0.737 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:07:51 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=30225.000 (unweighted 30225.000), BeginUsageTime=1395751882 >03/25/14 14:07:51 (Accountant) Checking Matches >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:07:51 Match already existed! >03/25/14 14:07:51 Previous Limits -- >03/25/14 14:07:51 Limit: test = 3.000000 >03/25/14 14:07:51 Limit: small.test = 2.000000 >03/25/14 14:07:51 Limit: medium.test = 5.000000 >03/25/14 14:07:51 Limit: undef.test = 1.000000 >03/25/14 14:07:51 Limit: undef = 1.000000 >03/25/14 14:07:51 Limit: large.test = 13.000000 >03/25/14 14:07:51 Limit: medium.undef = 5.000000 >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(medium.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(medium.undef) >03/25/14 14:07:51 IncrementLimit(small.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(medium.undef) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(medium.undef) >03/25/14 14:07:51 IncrementLimit(medium.undef) >03/25/14 14:07:51 IncrementLimit(medium.undef) >03/25/14 14:07:51 IncrementLimit(small.test) >03/25/14 14:07:51 IncrementLimit(test) >03/25/14 14:07:51 IncrementLimit(medium.test) >03/25/14 14:07:51 IncrementLimit(test) >03/25/14 14:07:51 IncrementLimit(medium.test) >03/25/14 14:07:51 IncrementLimit(test) >03/25/14 14:07:51 IncrementLimit(medium.test) >03/25/14 14:07:51 IncrementLimit(undef.test) >03/25/14 14:07:51 IncrementLimit(medium.test) >03/25/14 14:07:51 IncrementLimit(undef) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 IncrementLimit(large.test) >03/25/14 14:07:51 Current Limits -- >03/25/14 14:07:51 Limit: test = 3.000000 >03/25/14 14:07:51 Limit: small.test = 2.000000 >03/25/14 14:07:51 Limit: medium.test = 5.000000 >03/25/14 14:07:51 Limit: undef.test = 1.000000 >03/25/14 14:07:51 Limit: undef = 1.000000 >03/25/14 14:07:51 Limit: large.test = 13.000000 >03/25/14 14:07:51 Limit: medium.undef = 5.000000 >03/25/14 14:07:51 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:07:51 Phase 4.1: Negotiating with schedds ... >03/25/14 14:07:51 numSlots = 30 >03/25/14 14:07:51 slotWeightTotal = 30.000000 >03/25/14 14:07:51 pieLeft = 0.000 >03/25/14 14:07:51 NormalFactor = 1.000000 >03/25/14 14:07:51 MaxPrioValue = 0.737481 >03/25/14 14:07:51 NumSubmitterAds = 1 >03/25/14 14:07:51 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:07:51 0 seconds so far >03/25/14 14:07:51 Calculating submitter limit with the following parameters >03/25/14 14:07:51 SubmitterPrio = 0.737481 >03/25/14 14:07:51 SubmitterPrioFactor = 1.000000 >03/25/14 14:07:51 submitterShare = 1.000000 >03/25/14 14:07:51 submitterAbsShare = 1.000000 >03/25/14 14:07:51 submitterLimit = 0.000000 >03/25/14 14:07:51 submitterUsage = 30.000000 >03/25/14 14:07:51 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:07:51 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00011: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: large.test is 13.000000 >03/25/14 14:07:51 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:07:51 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00025: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:07:51 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:51 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00042: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: small.test is 2.000000 >03/25/14 14:07:51 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:07:51 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00063: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: test is 3.000000 >03/25/14 14:07:51 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:07:51 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00081: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:07:51 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:51 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00101: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: undef is 1.000000 >03/25/14 14:07:51 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:07:51 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got JOB_INFO command; getting classad/eom >03/25/14 14:07:51 Request 00001.00125: >03/25/14 14:07:51 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:07:51 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:07:51 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:07:51 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:07:51 Sending SEND_JOB_INFO/eom >03/25/14 14:07:51 Getting reply from schedd ... >03/25/14 14:07:51 Got NO_MORE_JOBS; done negotiating >03/25/14 14:07:51 This submitter hit its submitterLimit. >03/25/14 14:07:51 resources used scheddUsed= 30.000000 >03/25/14 14:07:51 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:07:51 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:07:51 Getting monitoring info for pid 22893 >03/25/14 14:07:52 Getting monitoring info for pid 22893 >03/25/14 14:07:53 Getting monitoring info for pid 22893 >03/25/14 14:07:54 Getting monitoring info for pid 22893 >03/25/14 14:07:55 Getting monitoring info for pid 22893 >03/25/14 14:07:56 Getting monitoring info for pid 22893 >03/25/14 14:07:57 Getting monitoring info for pid 22893 >03/25/14 14:07:58 Getting monitoring info for pid 22893 >03/25/14 14:07:59 Getting monitoring info for pid 22893 >03/25/14 14:08:00 Getting monitoring info for pid 22893 >03/25/14 14:08:01 Getting monitoring info for pid 22893 >03/25/14 14:08:02 Getting monitoring info for pid 22893 >03/25/14 14:08:03 Getting monitoring info for pid 22893 >03/25/14 14:08:04 Getting monitoring info for pid 22893 >03/25/14 14:08:05 Getting monitoring info for pid 22893 >03/25/14 14:08:06 Getting monitoring info for pid 22893 >03/25/14 14:08:07 Getting monitoring info for pid 22893 >03/25/14 14:08:08 Getting monitoring info for pid 22893 >03/25/14 14:08:09 Getting monitoring info for pid 22893 >03/25/14 14:08:10 Getting monitoring info for pid 22893 >03/25/14 14:08:11 ---------- Started Negotiation Cycle ---------- >03/25/14 14:08:11 Phase 1: Obtaining ads from collector ... >03/25/14 14:08:11 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:08:11 Trying to query collector <IP:9618> >03/25/14 14:08:11 Sorting 32 ads ... >03/25/14 14:08:11 Getting startd private ads ... >03/25/14 14:08:11 Trying to query collector <IP:9618> >03/25/14 14:08:11 Got ads: 32 public and 30 private >03/25/14 14:08:11 Public ads include 1 submitter, 30 startd >03/25/14 14:08:11 Phase 2: Performing accounting ... >03/25/14 14:08:11 Entering compute_significant_attrs() >03/25/14 14:08:11 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:08:11 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:08:11 CustomerName=Customer.<none> , Old Priority=0.737 , New Priority=0.742 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:11 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=30825.000 (unweighted 30825.000), BeginUsageTime=1395751882 >03/25/14 14:08:11 CustomerName=Customer.test@<hostname> , Old Priority=0.737 , New Priority=0.742 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:11 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=30825.000 (unweighted 30825.000), BeginUsageTime=1395751882 >03/25/14 14:08:11 (Accountant) Checking Matches >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:08:11 Match already existed! >03/25/14 14:08:11 Previous Limits -- >03/25/14 14:08:11 Limit: test = 3.000000 >03/25/14 14:08:11 Limit: small.test = 2.000000 >03/25/14 14:08:11 Limit: medium.test = 5.000000 >03/25/14 14:08:11 Limit: undef.test = 1.000000 >03/25/14 14:08:11 Limit: undef = 1.000000 >03/25/14 14:08:11 Limit: large.test = 13.000000 >03/25/14 14:08:11 Limit: medium.undef = 5.000000 >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(medium.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(medium.undef) >03/25/14 14:08:11 IncrementLimit(small.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(medium.undef) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(medium.undef) >03/25/14 14:08:11 IncrementLimit(medium.undef) >03/25/14 14:08:11 IncrementLimit(medium.undef) >03/25/14 14:08:11 IncrementLimit(small.test) >03/25/14 14:08:11 IncrementLimit(test) >03/25/14 14:08:11 IncrementLimit(medium.test) >03/25/14 14:08:11 IncrementLimit(test) >03/25/14 14:08:11 IncrementLimit(medium.test) >03/25/14 14:08:11 IncrementLimit(test) >03/25/14 14:08:11 IncrementLimit(medium.test) >03/25/14 14:08:11 IncrementLimit(undef.test) >03/25/14 14:08:11 IncrementLimit(medium.test) >03/25/14 14:08:11 IncrementLimit(undef) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 IncrementLimit(large.test) >03/25/14 14:08:11 Current Limits -- >03/25/14 14:08:11 Limit: test = 3.000000 >03/25/14 14:08:11 Limit: small.test = 2.000000 >03/25/14 14:08:11 Limit: medium.test = 5.000000 >03/25/14 14:08:11 Limit: undef.test = 1.000000 >03/25/14 14:08:11 Limit: undef = 1.000000 >03/25/14 14:08:11 Limit: large.test = 13.000000 >03/25/14 14:08:11 Limit: medium.undef = 5.000000 >03/25/14 14:08:11 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:08:11 Phase 4.1: Negotiating with schedds ... >03/25/14 14:08:11 numSlots = 30 >03/25/14 14:08:11 slotWeightTotal = 30.000000 >03/25/14 14:08:11 pieLeft = 0.000 >03/25/14 14:08:11 NormalFactor = 1.000000 >03/25/14 14:08:11 MaxPrioValue = 0.742176 >03/25/14 14:08:11 NumSubmitterAds = 1 >03/25/14 14:08:11 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:08:11 0 seconds so far >03/25/14 14:08:11 Calculating submitter limit with the following parameters >03/25/14 14:08:11 SubmitterPrio = 0.742176 >03/25/14 14:08:11 SubmitterPrioFactor = 1.000000 >03/25/14 14:08:11 submitterShare = 1.000000 >03/25/14 14:08:11 submitterAbsShare = 1.000000 >03/25/14 14:08:11 submitterLimit = 0.000000 >03/25/14 14:08:11 submitterUsage = 30.000000 >03/25/14 14:08:11 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:08:11 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00011: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: large.test is 13.000000 >03/25/14 14:08:11 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:08:11 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00025: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:08:11 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:11 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00042: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: small.test is 2.000000 >03/25/14 14:08:11 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:08:11 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00063: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: test is 3.000000 >03/25/14 14:08:11 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:08:11 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00081: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:08:11 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:11 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00101: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: undef is 1.000000 >03/25/14 14:08:11 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:11 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:11 Request 00001.00125: >03/25/14 14:08:11 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:11 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:08:11 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:11 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:08:11 Sending SEND_JOB_INFO/eom >03/25/14 14:08:11 Getting reply from schedd ... >03/25/14 14:08:11 Got NO_MORE_JOBS; done negotiating >03/25/14 14:08:11 This submitter hit its submitterLimit. >03/25/14 14:08:11 resources used scheddUsed= 30.000000 >03/25/14 14:08:11 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:08:11 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:08:11 Getting monitoring info for pid 22893 >03/25/14 14:08:12 Getting monitoring info for pid 22893 >03/25/14 14:08:13 Getting monitoring info for pid 22893 >03/25/14 14:08:14 Getting monitoring info for pid 22893 >03/25/14 14:08:15 Getting monitoring info for pid 22893 >03/25/14 14:08:16 Getting monitoring info for pid 22893 >03/25/14 14:08:17 Getting monitoring info for pid 22893 >03/25/14 14:08:18 Getting monitoring info for pid 22893 >03/25/14 14:08:19 Getting monitoring info for pid 22893 >03/25/14 14:08:20 Getting monitoring info for pid 22893 >03/25/14 14:08:21 Getting monitoring info for pid 22893 >03/25/14 14:08:22 Getting monitoring info for pid 22893 >03/25/14 14:08:23 Getting monitoring info for pid 22893 >03/25/14 14:08:24 Getting monitoring info for pid 22893 >03/25/14 14:08:25 Getting monitoring info for pid 22893 >03/25/14 14:08:26 Getting monitoring info for pid 22893 >03/25/14 14:08:27 Getting monitoring info for pid 22893 >03/25/14 14:08:28 Getting monitoring info for pid 22893 >03/25/14 14:08:29 Getting monitoring info for pid 22893 >03/25/14 14:08:30 Getting monitoring info for pid 22893 >03/25/14 14:08:31 ---------- Started Negotiation Cycle ---------- >03/25/14 14:08:31 Phase 1: Obtaining ads from collector ... >03/25/14 14:08:31 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:08:31 Trying to query collector <IP:9618> >03/25/14 14:08:31 Sorting 32 ads ... >03/25/14 14:08:31 Getting startd private ads ... >03/25/14 14:08:31 Trying to query collector <IP:9618> >03/25/14 14:08:31 Got ads: 32 public and 30 private >03/25/14 14:08:31 Public ads include 1 submitter, 30 startd >03/25/14 14:08:31 Phase 2: Performing accounting ... >03/25/14 14:08:31 Entering compute_significant_attrs() >03/25/14 14:08:31 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:08:31 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:08:31 CustomerName=Customer.<none> , Old Priority=0.742 , New Priority=0.747 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:31 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=31425.000 (unweighted 31425.000), BeginUsageTime=1395751882 >03/25/14 14:08:31 CustomerName=Customer.test@<hostname> , Old Priority=0.742 , New Priority=0.747 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:31 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=31425.000 (unweighted 31425.000), BeginUsageTime=1395751882 >03/25/14 14:08:31 (Accountant) Checking Matches >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:08:31 Match already existed! >03/25/14 14:08:31 Previous Limits -- >03/25/14 14:08:31 Limit: test = 3.000000 >03/25/14 14:08:31 Limit: small.test = 2.000000 >03/25/14 14:08:31 Limit: medium.test = 5.000000 >03/25/14 14:08:31 Limit: undef.test = 1.000000 >03/25/14 14:08:31 Limit: undef = 1.000000 >03/25/14 14:08:31 Limit: large.test = 13.000000 >03/25/14 14:08:31 Limit: medium.undef = 5.000000 >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(medium.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(medium.undef) >03/25/14 14:08:31 IncrementLimit(small.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(medium.undef) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(medium.undef) >03/25/14 14:08:31 IncrementLimit(medium.undef) >03/25/14 14:08:31 IncrementLimit(medium.undef) >03/25/14 14:08:31 IncrementLimit(small.test) >03/25/14 14:08:31 IncrementLimit(test) >03/25/14 14:08:31 IncrementLimit(medium.test) >03/25/14 14:08:31 IncrementLimit(test) >03/25/14 14:08:31 IncrementLimit(medium.test) >03/25/14 14:08:31 IncrementLimit(test) >03/25/14 14:08:31 IncrementLimit(medium.test) >03/25/14 14:08:31 IncrementLimit(undef.test) >03/25/14 14:08:31 IncrementLimit(medium.test) >03/25/14 14:08:31 IncrementLimit(undef) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 IncrementLimit(large.test) >03/25/14 14:08:31 Current Limits -- >03/25/14 14:08:31 Limit: test = 3.000000 >03/25/14 14:08:31 Limit: small.test = 2.000000 >03/25/14 14:08:31 Limit: medium.test = 5.000000 >03/25/14 14:08:31 Limit: undef.test = 1.000000 >03/25/14 14:08:31 Limit: undef = 1.000000 >03/25/14 14:08:31 Limit: large.test = 13.000000 >03/25/14 14:08:31 Limit: medium.undef = 5.000000 >03/25/14 14:08:31 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:08:31 Phase 4.1: Negotiating with schedds ... >03/25/14 14:08:31 numSlots = 30 >03/25/14 14:08:31 slotWeightTotal = 30.000000 >03/25/14 14:08:31 pieLeft = 0.000 >03/25/14 14:08:31 NormalFactor = 1.000000 >03/25/14 14:08:31 MaxPrioValue = 0.746871 >03/25/14 14:08:31 NumSubmitterAds = 1 >03/25/14 14:08:31 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:08:31 0 seconds so far >03/25/14 14:08:31 Calculating submitter limit with the following parameters >03/25/14 14:08:31 SubmitterPrio = 0.746871 >03/25/14 14:08:31 SubmitterPrioFactor = 1.000000 >03/25/14 14:08:31 submitterShare = 1.000000 >03/25/14 14:08:31 submitterAbsShare = 1.000000 >03/25/14 14:08:31 submitterLimit = 0.000000 >03/25/14 14:08:31 submitterUsage = 30.000000 >03/25/14 14:08:31 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:08:31 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00011: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: large.test is 13.000000 >03/25/14 14:08:31 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:08:31 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00025: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:08:31 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:31 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00042: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: small.test is 2.000000 >03/25/14 14:08:31 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:08:31 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00063: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: test is 3.000000 >03/25/14 14:08:31 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:08:31 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00081: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:08:31 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:31 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00101: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: undef is 1.000000 >03/25/14 14:08:31 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:31 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:31 Request 00001.00125: >03/25/14 14:08:31 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:31 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:08:31 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:31 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:08:31 Sending SEND_JOB_INFO/eom >03/25/14 14:08:31 Getting reply from schedd ... >03/25/14 14:08:31 Got NO_MORE_JOBS; done negotiating >03/25/14 14:08:31 This submitter hit its submitterLimit. >03/25/14 14:08:31 resources used scheddUsed= 30.000000 >03/25/14 14:08:31 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:08:31 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:08:31 Getting monitoring info for pid 22893 >03/25/14 14:08:32 Getting monitoring info for pid 22893 >03/25/14 14:08:33 Getting monitoring info for pid 22893 >03/25/14 14:08:34 Getting monitoring info for pid 22893 >03/25/14 14:08:35 Getting monitoring info for pid 22893 >03/25/14 14:08:36 Getting monitoring info for pid 22893 >03/25/14 14:08:37 Getting monitoring info for pid 22893 >03/25/14 14:08:38 Getting monitoring info for pid 22893 >03/25/14 14:08:39 Getting monitoring info for pid 22893 >03/25/14 14:08:40 Getting monitoring info for pid 22893 >03/25/14 14:08:41 Getting monitoring info for pid 22893 >03/25/14 14:08:42 Getting monitoring info for pid 22893 >03/25/14 14:08:43 Getting monitoring info for pid 22893 >03/25/14 14:08:44 Getting monitoring info for pid 22893 >03/25/14 14:08:45 Getting monitoring info for pid 22893 >03/25/14 14:08:46 Getting monitoring info for pid 22893 >03/25/14 14:08:47 Getting monitoring info for pid 22893 >03/25/14 14:08:48 Getting monitoring info for pid 22893 >03/25/14 14:08:49 Getting monitoring info for pid 22893 >03/25/14 14:08:50 Getting monitoring info for pid 22893 >03/25/14 14:08:51 ---------- Started Negotiation Cycle ---------- >03/25/14 14:08:51 Phase 1: Obtaining ads from collector ... >03/25/14 14:08:51 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:08:51 Trying to query collector <IP:9618> >03/25/14 14:08:51 Sorting 32 ads ... >03/25/14 14:08:51 Getting startd private ads ... >03/25/14 14:08:51 Trying to query collector <IP:9618> >03/25/14 14:08:52 Got ads: 32 public and 30 private >03/25/14 14:08:52 Public ads include 1 submitter, 30 startd >03/25/14 14:08:52 Phase 2: Performing accounting ... >03/25/14 14:08:52 Entering compute_significant_attrs() >03/25/14 14:08:52 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:08:52 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:08:52 CustomerName=Customer.<none> , Old Priority=0.747 , New Priority=0.752 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:52 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=32055.000 (unweighted 32055.000), BeginUsageTime=1395751882 >03/25/14 14:08:52 CustomerName=Customer.test@<hostname> , Old Priority=0.747 , New Priority=0.752 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:08:52 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=32055.000 (unweighted 32055.000), BeginUsageTime=1395751882 >03/25/14 14:08:52 (Accountant) Checking Matches >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:08:52 Match already existed! >03/25/14 14:08:52 Previous Limits -- >03/25/14 14:08:52 Limit: test = 3.000000 >03/25/14 14:08:52 Limit: small.test = 2.000000 >03/25/14 14:08:52 Limit: medium.test = 5.000000 >03/25/14 14:08:52 Limit: undef.test = 1.000000 >03/25/14 14:08:52 Limit: undef = 1.000000 >03/25/14 14:08:52 Limit: large.test = 13.000000 >03/25/14 14:08:52 Limit: medium.undef = 5.000000 >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(medium.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(medium.undef) >03/25/14 14:08:52 IncrementLimit(small.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(medium.undef) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(medium.undef) >03/25/14 14:08:52 IncrementLimit(medium.undef) >03/25/14 14:08:52 IncrementLimit(medium.undef) >03/25/14 14:08:52 IncrementLimit(small.test) >03/25/14 14:08:52 IncrementLimit(test) >03/25/14 14:08:52 IncrementLimit(medium.test) >03/25/14 14:08:52 IncrementLimit(test) >03/25/14 14:08:52 IncrementLimit(medium.test) >03/25/14 14:08:52 IncrementLimit(test) >03/25/14 14:08:52 IncrementLimit(medium.test) >03/25/14 14:08:52 IncrementLimit(undef.test) >03/25/14 14:08:52 IncrementLimit(medium.test) >03/25/14 14:08:52 IncrementLimit(undef) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 IncrementLimit(large.test) >03/25/14 14:08:52 Current Limits -- >03/25/14 14:08:52 Limit: test = 3.000000 >03/25/14 14:08:52 Limit: small.test = 2.000000 >03/25/14 14:08:52 Limit: medium.test = 5.000000 >03/25/14 14:08:52 Limit: undef.test = 1.000000 >03/25/14 14:08:52 Limit: undef = 1.000000 >03/25/14 14:08:52 Limit: large.test = 13.000000 >03/25/14 14:08:52 Limit: medium.undef = 5.000000 >03/25/14 14:08:52 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:08:52 Phase 4.1: Negotiating with schedds ... >03/25/14 14:08:52 numSlots = 30 >03/25/14 14:08:52 slotWeightTotal = 30.000000 >03/25/14 14:08:52 pieLeft = 0.000 >03/25/14 14:08:52 NormalFactor = 1.000000 >03/25/14 14:08:52 MaxPrioValue = 0.751798 >03/25/14 14:08:52 NumSubmitterAds = 1 >03/25/14 14:08:52 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:08:52 0 seconds so far >03/25/14 14:08:52 Calculating submitter limit with the following parameters >03/25/14 14:08:52 SubmitterPrio = 0.751798 >03/25/14 14:08:52 SubmitterPrioFactor = 1.000000 >03/25/14 14:08:52 submitterShare = 1.000000 >03/25/14 14:08:52 submitterAbsShare = 1.000000 >03/25/14 14:08:52 submitterLimit = 0.000000 >03/25/14 14:08:52 submitterUsage = 30.000000 >03/25/14 14:08:52 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:08:52 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00011: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: large.test is 13.000000 >03/25/14 14:08:52 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:08:52 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00025: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:08:52 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:52 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00042: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: small.test is 2.000000 >03/25/14 14:08:52 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:08:52 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00063: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: test is 3.000000 >03/25/14 14:08:52 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:08:52 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00081: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:08:52 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:52 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00101: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: undef is 1.000000 >03/25/14 14:08:52 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:08:52 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got JOB_INFO command; getting classad/eom >03/25/14 14:08:52 Request 00001.00125: >03/25/14 14:08:52 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:08:52 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:08:52 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:08:52 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:08:52 Sending SEND_JOB_INFO/eom >03/25/14 14:08:52 Getting reply from schedd ... >03/25/14 14:08:52 Got NO_MORE_JOBS; done negotiating >03/25/14 14:08:52 This submitter hit its submitterLimit. >03/25/14 14:08:52 resources used scheddUsed= 30.000000 >03/25/14 14:08:52 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:08:52 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:08:52 Getting monitoring info for pid 22893 >03/25/14 14:08:53 Getting monitoring info for pid 22893 >03/25/14 14:08:54 Getting monitoring info for pid 22893 >03/25/14 14:08:55 Getting monitoring info for pid 22893 >03/25/14 14:08:56 Getting monitoring info for pid 22893 >03/25/14 14:08:57 Getting monitoring info for pid 22893 >03/25/14 14:08:58 Getting monitoring info for pid 22893 >03/25/14 14:08:59 Getting monitoring info for pid 22893 >03/25/14 14:09:00 Getting monitoring info for pid 22893 >03/25/14 14:09:01 Getting monitoring info for pid 22893 >03/25/14 14:09:02 Getting monitoring info for pid 22893 >03/25/14 14:09:03 Getting monitoring info for pid 22893 >03/25/14 14:09:04 Getting monitoring info for pid 22893 >03/25/14 14:09:05 Getting monitoring info for pid 22893 >03/25/14 14:09:06 Getting monitoring info for pid 22893 >03/25/14 14:09:07 Getting monitoring info for pid 22893 >03/25/14 14:09:08 Getting monitoring info for pid 22893 >03/25/14 14:09:09 Getting monitoring info for pid 22893 >03/25/14 14:09:10 Getting monitoring info for pid 22893 >03/25/14 14:09:11 Getting monitoring info for pid 22893 >03/25/14 14:09:12 ---------- Started Negotiation Cycle ---------- >03/25/14 14:09:12 Phase 1: Obtaining ads from collector ... >03/25/14 14:09:12 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:09:12 Trying to query collector <IP:9618> >03/25/14 14:09:12 Sorting 32 ads ... >03/25/14 14:09:12 Getting startd private ads ... >03/25/14 14:09:12 Trying to query collector <IP:9618> >03/25/14 14:09:12 Got ads: 32 public and 30 private >03/25/14 14:09:12 Public ads include 1 submitter, 30 startd >03/25/14 14:09:12 Phase 2: Performing accounting ... >03/25/14 14:09:12 Entering compute_significant_attrs() >03/25/14 14:09:12 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:09:12 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:09:12 CustomerName=Customer.<none> , Old Priority=0.752 , New Priority=0.756 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:12 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=32655.000 (unweighted 32655.000), BeginUsageTime=1395751882 >03/25/14 14:09:12 CustomerName=Customer.test@<hostname> , Old Priority=0.752 , New Priority=0.756 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:12 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=32655.000 (unweighted 32655.000), BeginUsageTime=1395751882 >03/25/14 14:09:12 (Accountant) Checking Matches >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:09:12 Match already existed! >03/25/14 14:09:12 Previous Limits -- >03/25/14 14:09:12 Limit: test = 3.000000 >03/25/14 14:09:12 Limit: small.test = 2.000000 >03/25/14 14:09:12 Limit: medium.test = 5.000000 >03/25/14 14:09:12 Limit: undef.test = 1.000000 >03/25/14 14:09:12 Limit: undef = 1.000000 >03/25/14 14:09:12 Limit: large.test = 13.000000 >03/25/14 14:09:12 Limit: medium.undef = 5.000000 >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(medium.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(medium.undef) >03/25/14 14:09:12 IncrementLimit(small.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(medium.undef) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(medium.undef) >03/25/14 14:09:12 IncrementLimit(medium.undef) >03/25/14 14:09:12 IncrementLimit(medium.undef) >03/25/14 14:09:12 IncrementLimit(small.test) >03/25/14 14:09:12 IncrementLimit(test) >03/25/14 14:09:12 IncrementLimit(medium.test) >03/25/14 14:09:12 IncrementLimit(test) >03/25/14 14:09:12 IncrementLimit(medium.test) >03/25/14 14:09:12 IncrementLimit(test) >03/25/14 14:09:12 IncrementLimit(medium.test) >03/25/14 14:09:12 IncrementLimit(undef.test) >03/25/14 14:09:12 IncrementLimit(medium.test) >03/25/14 14:09:12 IncrementLimit(undef) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 IncrementLimit(large.test) >03/25/14 14:09:12 Current Limits -- >03/25/14 14:09:12 Limit: test = 3.000000 >03/25/14 14:09:12 Limit: small.test = 2.000000 >03/25/14 14:09:12 Limit: medium.test = 5.000000 >03/25/14 14:09:12 Limit: undef.test = 1.000000 >03/25/14 14:09:12 Limit: undef = 1.000000 >03/25/14 14:09:12 Limit: large.test = 13.000000 >03/25/14 14:09:12 Limit: medium.undef = 5.000000 >03/25/14 14:09:12 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:09:12 Phase 4.1: Negotiating with schedds ... >03/25/14 14:09:12 numSlots = 30 >03/25/14 14:09:12 slotWeightTotal = 30.000000 >03/25/14 14:09:12 pieLeft = 0.000 >03/25/14 14:09:12 NormalFactor = 1.000000 >03/25/14 14:09:12 MaxPrioValue = 0.756491 >03/25/14 14:09:12 NumSubmitterAds = 1 >03/25/14 14:09:12 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:09:12 0 seconds so far >03/25/14 14:09:12 Calculating submitter limit with the following parameters >03/25/14 14:09:12 SubmitterPrio = 0.756491 >03/25/14 14:09:12 SubmitterPrioFactor = 1.000000 >03/25/14 14:09:12 submitterShare = 1.000000 >03/25/14 14:09:12 submitterAbsShare = 1.000000 >03/25/14 14:09:12 submitterLimit = 0.000000 >03/25/14 14:09:12 submitterUsage = 30.000000 >03/25/14 14:09:12 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:09:12 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00011: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: large.test is 13.000000 >03/25/14 14:09:12 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:09:12 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00025: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:09:12 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:12 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00042: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: small.test is 2.000000 >03/25/14 14:09:12 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:09:12 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00063: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: test is 3.000000 >03/25/14 14:09:12 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:09:12 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00081: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:09:12 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:12 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00101: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: undef is 1.000000 >03/25/14 14:09:12 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:12 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:12 Request 00001.00125: >03/25/14 14:09:12 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:12 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:09:12 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:12 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:09:12 Sending SEND_JOB_INFO/eom >03/25/14 14:09:12 Getting reply from schedd ... >03/25/14 14:09:12 Got NO_MORE_JOBS; done negotiating >03/25/14 14:09:12 This submitter hit its submitterLimit. >03/25/14 14:09:12 resources used scheddUsed= 30.000000 >03/25/14 14:09:12 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:09:12 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:09:12 Getting monitoring info for pid 22893 >03/25/14 14:09:13 Getting monitoring info for pid 22893 >03/25/14 14:09:14 Getting monitoring info for pid 22893 >03/25/14 14:09:15 Getting monitoring info for pid 22893 >03/25/14 14:09:16 Getting monitoring info for pid 22893 >03/25/14 14:09:17 Getting monitoring info for pid 22893 >03/25/14 14:09:18 Getting monitoring info for pid 22893 >03/25/14 14:09:19 Getting monitoring info for pid 22893 >03/25/14 14:09:20 Getting monitoring info for pid 22893 >03/25/14 14:09:21 Getting monitoring info for pid 22893 >03/25/14 14:09:22 Getting monitoring info for pid 22893 >03/25/14 14:09:23 Getting monitoring info for pid 22893 >03/25/14 14:09:24 Getting monitoring info for pid 22893 >03/25/14 14:09:25 Getting monitoring info for pid 22893 >03/25/14 14:09:26 Getting monitoring info for pid 22893 >03/25/14 14:09:27 Getting monitoring info for pid 22893 >03/25/14 14:09:28 Getting monitoring info for pid 22893 >03/25/14 14:09:29 Getting monitoring info for pid 22893 >03/25/14 14:09:30 Getting monitoring info for pid 22893 >03/25/14 14:09:31 Getting monitoring info for pid 22893 >03/25/14 14:09:32 ---------- Started Negotiation Cycle ---------- >03/25/14 14:09:32 Phase 1: Obtaining ads from collector ... >03/25/14 14:09:32 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:09:32 Trying to query collector <IP:9618> >03/25/14 14:09:32 Sorting 32 ads ... >03/25/14 14:09:32 Getting startd private ads ... >03/25/14 14:09:32 Trying to query collector <IP:9618> >03/25/14 14:09:32 Got ads: 32 public and 30 private >03/25/14 14:09:32 Public ads include 1 submitter, 30 startd >03/25/14 14:09:32 Phase 2: Performing accounting ... >03/25/14 14:09:32 Entering compute_significant_attrs() >03/25/14 14:09:32 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:09:32 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:09:32 CustomerName=Customer.<none> , Old Priority=0.756 , New Priority=0.761 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:32 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=33255.000 (unweighted 33255.000), BeginUsageTime=1395751882 >03/25/14 14:09:32 CustomerName=Customer.test@<hostname> , Old Priority=0.756 , New Priority=0.761 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:32 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=33255.000 (unweighted 33255.000), BeginUsageTime=1395751882 >03/25/14 14:09:33 (Accountant) Checking Matches >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:09:33 Match already existed! >03/25/14 14:09:33 Previous Limits -- >03/25/14 14:09:33 Limit: test = 3.000000 >03/25/14 14:09:33 Limit: small.test = 2.000000 >03/25/14 14:09:33 Limit: medium.test = 5.000000 >03/25/14 14:09:33 Limit: undef.test = 1.000000 >03/25/14 14:09:33 Limit: undef = 1.000000 >03/25/14 14:09:33 Limit: large.test = 13.000000 >03/25/14 14:09:33 Limit: medium.undef = 5.000000 >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(medium.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(medium.undef) >03/25/14 14:09:33 IncrementLimit(small.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(medium.undef) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(medium.undef) >03/25/14 14:09:33 IncrementLimit(medium.undef) >03/25/14 14:09:33 IncrementLimit(medium.undef) >03/25/14 14:09:33 IncrementLimit(small.test) >03/25/14 14:09:33 IncrementLimit(test) >03/25/14 14:09:33 IncrementLimit(medium.test) >03/25/14 14:09:33 IncrementLimit(test) >03/25/14 14:09:33 IncrementLimit(medium.test) >03/25/14 14:09:33 IncrementLimit(test) >03/25/14 14:09:33 IncrementLimit(medium.test) >03/25/14 14:09:33 IncrementLimit(undef.test) >03/25/14 14:09:33 IncrementLimit(medium.test) >03/25/14 14:09:33 IncrementLimit(undef) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 IncrementLimit(large.test) >03/25/14 14:09:33 Current Limits -- >03/25/14 14:09:33 Limit: test = 3.000000 >03/25/14 14:09:33 Limit: small.test = 2.000000 >03/25/14 14:09:33 Limit: medium.test = 5.000000 >03/25/14 14:09:33 Limit: undef.test = 1.000000 >03/25/14 14:09:33 Limit: undef = 1.000000 >03/25/14 14:09:33 Limit: large.test = 13.000000 >03/25/14 14:09:33 Limit: medium.undef = 5.000000 >03/25/14 14:09:33 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:09:33 Phase 4.1: Negotiating with schedds ... >03/25/14 14:09:33 numSlots = 30 >03/25/14 14:09:33 slotWeightTotal = 30.000000 >03/25/14 14:09:33 pieLeft = 0.000 >03/25/14 14:09:33 NormalFactor = 1.000000 >03/25/14 14:09:33 MaxPrioValue = 0.761183 >03/25/14 14:09:33 NumSubmitterAds = 1 >03/25/14 14:09:33 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:09:33 0 seconds so far >03/25/14 14:09:33 Calculating submitter limit with the following parameters >03/25/14 14:09:33 SubmitterPrio = 0.761183 >03/25/14 14:09:33 SubmitterPrioFactor = 1.000000 >03/25/14 14:09:33 submitterShare = 1.000000 >03/25/14 14:09:33 submitterAbsShare = 1.000000 >03/25/14 14:09:33 submitterLimit = 0.000000 >03/25/14 14:09:33 submitterUsage = 30.000000 >03/25/14 14:09:33 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:09:33 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00011: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: large.test is 13.000000 >03/25/14 14:09:33 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:09:33 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00025: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:09:33 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:33 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00042: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: small.test is 2.000000 >03/25/14 14:09:33 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:09:33 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00063: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: test is 3.000000 >03/25/14 14:09:33 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:09:33 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00081: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:09:33 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:33 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00101: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: undef is 1.000000 >03/25/14 14:09:33 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:33 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:33 Request 00001.00125: >03/25/14 14:09:33 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:33 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:09:33 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:33 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:09:33 Sending SEND_JOB_INFO/eom >03/25/14 14:09:33 Getting reply from schedd ... >03/25/14 14:09:33 Got NO_MORE_JOBS; done negotiating >03/25/14 14:09:33 This submitter hit its submitterLimit. >03/25/14 14:09:33 resources used scheddUsed= 30.000000 >03/25/14 14:09:33 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:09:33 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:09:33 Getting monitoring info for pid 22893 >03/25/14 14:09:34 Getting monitoring info for pid 22893 >03/25/14 14:09:35 Getting monitoring info for pid 22893 >03/25/14 14:09:36 Getting monitoring info for pid 22893 >03/25/14 14:09:37 Getting monitoring info for pid 22893 >03/25/14 14:09:38 Getting monitoring info for pid 22893 >03/25/14 14:09:39 Getting monitoring info for pid 22893 >03/25/14 14:09:40 Getting monitoring info for pid 22893 >03/25/14 14:09:41 Getting monitoring info for pid 22893 >03/25/14 14:09:42 Getting monitoring info for pid 22893 >03/25/14 14:09:43 Getting monitoring info for pid 22893 >03/25/14 14:09:44 Getting monitoring info for pid 22893 >03/25/14 14:09:45 Getting monitoring info for pid 22893 >03/25/14 14:09:46 Getting monitoring info for pid 22893 >03/25/14 14:09:47 Getting monitoring info for pid 22893 >03/25/14 14:09:48 Getting monitoring info for pid 22893 >03/25/14 14:09:49 Getting monitoring info for pid 22893 >03/25/14 14:09:50 Getting monitoring info for pid 22893 >03/25/14 14:09:51 Getting monitoring info for pid 22893 >03/25/14 14:09:52 Getting monitoring info for pid 22893 >03/25/14 14:09:53 ---------- Started Negotiation Cycle ---------- >03/25/14 14:09:53 Phase 1: Obtaining ads from collector ... >03/25/14 14:09:53 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:09:53 Trying to query collector <IP:9618> >03/25/14 14:09:53 Sorting 32 ads ... >03/25/14 14:09:53 Getting startd private ads ... >03/25/14 14:09:53 Trying to query collector <IP:9618> >03/25/14 14:09:53 Got ads: 32 public and 30 private >03/25/14 14:09:53 Public ads include 1 submitter, 30 startd >03/25/14 14:09:53 Phase 2: Performing accounting ... >03/25/14 14:09:53 Entering compute_significant_attrs() >03/25/14 14:09:53 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:09:53 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:09:53 CustomerName=Customer.<none> , Old Priority=0.761 , New Priority=0.766 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:53 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=33885.000 (unweighted 33885.000), BeginUsageTime=1395751882 >03/25/14 14:09:53 CustomerName=Customer.test@<hostname> , Old Priority=0.761 , New Priority=0.766 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:09:53 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=33885.000 (unweighted 33885.000), BeginUsageTime=1395751882 >03/25/14 14:09:53 (Accountant) Checking Matches >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:09:53 Match already existed! >03/25/14 14:09:53 Previous Limits -- >03/25/14 14:09:53 Limit: test = 3.000000 >03/25/14 14:09:53 Limit: small.test = 2.000000 >03/25/14 14:09:53 Limit: medium.test = 5.000000 >03/25/14 14:09:53 Limit: undef.test = 1.000000 >03/25/14 14:09:53 Limit: undef = 1.000000 >03/25/14 14:09:53 Limit: large.test = 13.000000 >03/25/14 14:09:53 Limit: medium.undef = 5.000000 >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(medium.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(medium.undef) >03/25/14 14:09:53 IncrementLimit(small.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(medium.undef) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(medium.undef) >03/25/14 14:09:53 IncrementLimit(medium.undef) >03/25/14 14:09:53 IncrementLimit(medium.undef) >03/25/14 14:09:53 IncrementLimit(small.test) >03/25/14 14:09:53 IncrementLimit(test) >03/25/14 14:09:53 IncrementLimit(medium.test) >03/25/14 14:09:53 IncrementLimit(test) >03/25/14 14:09:53 IncrementLimit(medium.test) >03/25/14 14:09:53 IncrementLimit(test) >03/25/14 14:09:53 IncrementLimit(medium.test) >03/25/14 14:09:53 IncrementLimit(undef.test) >03/25/14 14:09:53 IncrementLimit(medium.test) >03/25/14 14:09:53 IncrementLimit(undef) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 IncrementLimit(large.test) >03/25/14 14:09:53 Current Limits -- >03/25/14 14:09:53 Limit: test = 3.000000 >03/25/14 14:09:53 Limit: small.test = 2.000000 >03/25/14 14:09:53 Limit: medium.test = 5.000000 >03/25/14 14:09:53 Limit: undef.test = 1.000000 >03/25/14 14:09:53 Limit: undef = 1.000000 >03/25/14 14:09:53 Limit: large.test = 13.000000 >03/25/14 14:09:53 Limit: medium.undef = 5.000000 >03/25/14 14:09:54 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:09:54 Phase 4.1: Negotiating with schedds ... >03/25/14 14:09:54 numSlots = 30 >03/25/14 14:09:54 slotWeightTotal = 30.000000 >03/25/14 14:09:54 pieLeft = 0.000 >03/25/14 14:09:54 NormalFactor = 1.000000 >03/25/14 14:09:54 MaxPrioValue = 0.766108 >03/25/14 14:09:54 NumSubmitterAds = 1 >03/25/14 14:09:54 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:09:54 0 seconds so far >03/25/14 14:09:54 Calculating submitter limit with the following parameters >03/25/14 14:09:54 SubmitterPrio = 0.766108 >03/25/14 14:09:54 SubmitterPrioFactor = 1.000000 >03/25/14 14:09:54 submitterShare = 1.000000 >03/25/14 14:09:54 submitterAbsShare = 1.000000 >03/25/14 14:09:54 submitterLimit = 0.000000 >03/25/14 14:09:54 submitterUsage = 30.000000 >03/25/14 14:09:54 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:09:54 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00011: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: large.test is 13.000000 >03/25/14 14:09:54 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:09:54 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00025: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:09:54 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:54 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00042: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: small.test is 2.000000 >03/25/14 14:09:54 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:09:54 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00063: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: test is 3.000000 >03/25/14 14:09:54 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:09:54 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00081: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:09:54 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:54 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00101: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: undef is 1.000000 >03/25/14 14:09:54 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:09:54 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got JOB_INFO command; getting classad/eom >03/25/14 14:09:54 Request 00001.00125: >03/25/14 14:09:54 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:09:54 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:09:54 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:09:54 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:09:54 Sending SEND_JOB_INFO/eom >03/25/14 14:09:54 Getting reply from schedd ... >03/25/14 14:09:54 Got NO_MORE_JOBS; done negotiating >03/25/14 14:09:54 This submitter hit its submitterLimit. >03/25/14 14:09:54 resources used scheddUsed= 30.000000 >03/25/14 14:09:54 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:09:54 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:09:54 Getting monitoring info for pid 22893 >03/25/14 14:09:55 Getting monitoring info for pid 22893 >03/25/14 14:09:56 Getting monitoring info for pid 22893 >03/25/14 14:09:57 Getting monitoring info for pid 22893 >03/25/14 14:09:58 Getting monitoring info for pid 22893 >03/25/14 14:09:59 Getting monitoring info for pid 22893 >03/25/14 14:10:00 DaemonCore: in SendAliveToParent() >03/25/14 14:10:00 Completed DC_CHILDALIVE to daemon at <IP:53996> >03/25/14 14:10:00 DaemonCore: Leaving SendAliveToParent() - success >03/25/14 14:10:00 Getting monitoring info for pid 22893 >03/25/14 14:10:01 Getting monitoring info for pid 22893 >03/25/14 14:10:02 Getting monitoring info for pid 22893 >03/25/14 14:10:03 Getting monitoring info for pid 22893 >03/25/14 14:10:04 Getting monitoring info for pid 22893 >03/25/14 14:10:05 Getting monitoring info for pid 22893 >03/25/14 14:10:06 Getting monitoring info for pid 22893 >03/25/14 14:10:07 Getting monitoring info for pid 22893 >03/25/14 14:10:08 Getting monitoring info for pid 22893 >03/25/14 14:10:09 Getting monitoring info for pid 22893 >03/25/14 14:10:10 Getting monitoring info for pid 22893 >03/25/14 14:10:11 Getting monitoring info for pid 22893 >03/25/14 14:10:12 Getting monitoring info for pid 22893 >03/25/14 14:10:13 Getting monitoring info for pid 22893 >03/25/14 14:10:14 ---------- Started Negotiation Cycle ---------- >03/25/14 14:10:14 Phase 1: Obtaining ads from collector ... >03/25/14 14:10:14 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:10:14 Trying to query collector <IP:9618> >03/25/14 14:10:15 Sorting 32 ads ... >03/25/14 14:10:15 Getting startd private ads ... >03/25/14 14:10:15 Trying to query collector <IP:9618> >03/25/14 14:10:15 Got ads: 32 public and 30 private >03/25/14 14:10:15 Public ads include 1 submitter, 30 startd >03/25/14 14:10:15 Phase 2: Performing accounting ... >03/25/14 14:10:15 Entering compute_significant_attrs() >03/25/14 14:10:15 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:10:15 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=22 >03/25/14 14:10:15 CustomerName=Customer.<none> , Old Priority=0.766 , New Priority=0.771 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:15 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=34545.000 (unweighted 34545.000), BeginUsageTime=1395751882 >03/25/14 14:10:15 CustomerName=Customer.test@<hostname> , Old Priority=0.766 , New Priority=0.771 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:15 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=34545.000 (unweighted 34545.000), BeginUsageTime=1395751882 >03/25/14 14:10:15 (Accountant) Checking Matches >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:10:15 Match already existed! >03/25/14 14:10:15 Previous Limits -- >03/25/14 14:10:15 Limit: test = 3.000000 >03/25/14 14:10:15 Limit: small.test = 2.000000 >03/25/14 14:10:15 Limit: medium.test = 5.000000 >03/25/14 14:10:15 Limit: undef.test = 1.000000 >03/25/14 14:10:15 Limit: undef = 1.000000 >03/25/14 14:10:15 Limit: large.test = 13.000000 >03/25/14 14:10:15 Limit: medium.undef = 5.000000 >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(medium.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(medium.undef) >03/25/14 14:10:15 IncrementLimit(small.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(medium.undef) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(medium.undef) >03/25/14 14:10:15 IncrementLimit(medium.undef) >03/25/14 14:10:15 IncrementLimit(medium.undef) >03/25/14 14:10:15 IncrementLimit(small.test) >03/25/14 14:10:15 IncrementLimit(test) >03/25/14 14:10:15 IncrementLimit(medium.test) >03/25/14 14:10:15 IncrementLimit(test) >03/25/14 14:10:15 IncrementLimit(medium.test) >03/25/14 14:10:15 IncrementLimit(test) >03/25/14 14:10:15 IncrementLimit(medium.test) >03/25/14 14:10:15 IncrementLimit(undef.test) >03/25/14 14:10:15 IncrementLimit(medium.test) >03/25/14 14:10:15 IncrementLimit(undef) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 IncrementLimit(large.test) >03/25/14 14:10:15 Current Limits -- >03/25/14 14:10:15 Limit: test = 3.000000 >03/25/14 14:10:15 Limit: small.test = 2.000000 >03/25/14 14:10:15 Limit: medium.test = 5.000000 >03/25/14 14:10:15 Limit: undef.test = 1.000000 >03/25/14 14:10:15 Limit: undef = 1.000000 >03/25/14 14:10:15 Limit: large.test = 13.000000 >03/25/14 14:10:15 Limit: medium.undef = 5.000000 >03/25/14 14:10:15 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:10:15 Phase 4.1: Negotiating with schedds ... >03/25/14 14:10:15 numSlots = 30 >03/25/14 14:10:15 slotWeightTotal = 30.000000 >03/25/14 14:10:15 pieLeft = 0.000 >03/25/14 14:10:15 NormalFactor = 1.000000 >03/25/14 14:10:15 MaxPrioValue = 0.771267 >03/25/14 14:10:15 NumSubmitterAds = 1 >03/25/14 14:10:15 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:10:15 0 seconds so far >03/25/14 14:10:15 Calculating submitter limit with the following parameters >03/25/14 14:10:15 SubmitterPrio = 0.771267 >03/25/14 14:10:15 SubmitterPrioFactor = 1.000000 >03/25/14 14:10:15 submitterShare = 1.000000 >03/25/14 14:10:15 submitterAbsShare = 1.000000 >03/25/14 14:10:15 submitterLimit = 0.000000 >03/25/14 14:10:15 submitterUsage = 30.000000 >03/25/14 14:10:15 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:10:15 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00011: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: large.test is 13.000000 >03/25/14 14:10:15 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:10:15 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00025: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:10:15 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:15 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00042: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: small.test is 2.000000 >03/25/14 14:10:15 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:10:15 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00063: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: test is 3.000000 >03/25/14 14:10:15 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:10:15 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00081: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:10:15 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:15 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00101: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: undef is 1.000000 >03/25/14 14:10:15 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:15 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:15 Request 00001.00125: >03/25/14 14:10:15 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:15 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:10:15 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:15 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:10:15 Sending SEND_JOB_INFO/eom >03/25/14 14:10:15 Getting reply from schedd ... >03/25/14 14:10:15 Got NO_MORE_JOBS; done negotiating >03/25/14 14:10:15 This submitter hit its submitterLimit. >03/25/14 14:10:15 resources used scheddUsed= 30.000000 >03/25/14 14:10:15 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:10:15 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:10:15 Getting monitoring info for pid 22893 >03/25/14 14:10:16 Getting monitoring info for pid 22893 >03/25/14 14:10:17 Getting monitoring info for pid 22893 >03/25/14 14:10:18 Getting monitoring info for pid 22893 >03/25/14 14:10:19 Getting monitoring info for pid 22893 >03/25/14 14:10:20 Getting monitoring info for pid 22893 >03/25/14 14:10:21 Getting monitoring info for pid 22893 >03/25/14 14:10:22 Getting monitoring info for pid 22893 >03/25/14 14:10:23 Getting monitoring info for pid 22893 >03/25/14 14:10:24 Getting monitoring info for pid 22893 >03/25/14 14:10:25 Getting monitoring info for pid 22893 >03/25/14 14:10:26 Getting monitoring info for pid 22893 >03/25/14 14:10:27 Getting monitoring info for pid 22893 >03/25/14 14:10:28 Getting monitoring info for pid 22893 >03/25/14 14:10:29 Getting monitoring info for pid 22893 >03/25/14 14:10:30 enter Matchmaker::updateCollector >03/25/14 14:10:30 Warning: Could not find DaemonStartTime >03/25/14 14:10:30 Trying to update collector <IP:9618> >03/25/14 14:10:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:10:30 exit Matchmaker::UpdateCollector >03/25/14 14:10:30 Getting monitoring info for pid 22893 >03/25/14 14:10:31 Getting monitoring info for pid 22893 >03/25/14 14:10:32 Getting monitoring info for pid 22893 >03/25/14 14:10:33 Getting monitoring info for pid 22893 >03/25/14 14:10:34 Getting monitoring info for pid 22893 >03/25/14 14:10:35 ---------- Started Negotiation Cycle ---------- >03/25/14 14:10:35 Phase 1: Obtaining ads from collector ... >03/25/14 14:10:35 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:10:35 Trying to query collector <IP:9618> >03/25/14 14:10:35 Sorting 32 ads ... >03/25/14 14:10:35 Getting startd private ads ... >03/25/14 14:10:35 Trying to query collector <IP:9618> >03/25/14 14:10:35 Got ads: 32 public and 30 private >03/25/14 14:10:35 Public ads include 1 submitter, 30 startd >03/25/14 14:10:35 Phase 2: Performing accounting ... >03/25/14 14:10:35 Entering compute_significant_attrs() >03/25/14 14:10:35 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:10:35 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:10:35 CustomerName=Customer.<none> , Old Priority=0.771 , New Priority=0.776 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:35 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=35145.000 (unweighted 35145.000), BeginUsageTime=1395751882 >03/25/14 14:10:35 CustomerName=Customer.test@<hostname> , Old Priority=0.771 , New Priority=0.776 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:35 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=35145.000 (unweighted 35145.000), BeginUsageTime=1395751882 >03/25/14 14:10:35 (Accountant) Checking Matches >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:10:35 Match already existed! >03/25/14 14:10:35 Previous Limits -- >03/25/14 14:10:35 Limit: test = 3.000000 >03/25/14 14:10:35 Limit: small.test = 2.000000 >03/25/14 14:10:35 Limit: medium.test = 5.000000 >03/25/14 14:10:35 Limit: undef.test = 1.000000 >03/25/14 14:10:35 Limit: undef = 1.000000 >03/25/14 14:10:35 Limit: large.test = 13.000000 >03/25/14 14:10:35 Limit: medium.undef = 5.000000 >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(medium.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(medium.undef) >03/25/14 14:10:35 IncrementLimit(small.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(medium.undef) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(medium.undef) >03/25/14 14:10:35 IncrementLimit(medium.undef) >03/25/14 14:10:35 IncrementLimit(medium.undef) >03/25/14 14:10:35 IncrementLimit(small.test) >03/25/14 14:10:35 IncrementLimit(test) >03/25/14 14:10:35 IncrementLimit(medium.test) >03/25/14 14:10:35 IncrementLimit(test) >03/25/14 14:10:35 IncrementLimit(medium.test) >03/25/14 14:10:35 IncrementLimit(test) >03/25/14 14:10:35 IncrementLimit(medium.test) >03/25/14 14:10:35 IncrementLimit(undef.test) >03/25/14 14:10:35 IncrementLimit(medium.test) >03/25/14 14:10:35 IncrementLimit(undef) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 IncrementLimit(large.test) >03/25/14 14:10:35 Current Limits -- >03/25/14 14:10:35 Limit: test = 3.000000 >03/25/14 14:10:35 Limit: small.test = 2.000000 >03/25/14 14:10:35 Limit: medium.test = 5.000000 >03/25/14 14:10:35 Limit: undef.test = 1.000000 >03/25/14 14:10:35 Limit: undef = 1.000000 >03/25/14 14:10:35 Limit: large.test = 13.000000 >03/25/14 14:10:35 Limit: medium.undef = 5.000000 >03/25/14 14:10:35 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:10:35 Phase 4.1: Negotiating with schedds ... >03/25/14 14:10:35 numSlots = 30 >03/25/14 14:10:35 slotWeightTotal = 30.000000 >03/25/14 14:10:35 pieLeft = 0.000 >03/25/14 14:10:35 NormalFactor = 1.000000 >03/25/14 14:10:35 MaxPrioValue = 0.775957 >03/25/14 14:10:35 NumSubmitterAds = 1 >03/25/14 14:10:35 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:10:35 0 seconds so far >03/25/14 14:10:35 Calculating submitter limit with the following parameters >03/25/14 14:10:35 SubmitterPrio = 0.775957 >03/25/14 14:10:35 SubmitterPrioFactor = 1.000000 >03/25/14 14:10:35 submitterShare = 1.000000 >03/25/14 14:10:35 submitterAbsShare = 1.000000 >03/25/14 14:10:35 submitterLimit = 0.000000 >03/25/14 14:10:35 submitterUsage = 30.000000 >03/25/14 14:10:35 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:10:35 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00011: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: large.test is 13.000000 >03/25/14 14:10:35 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:10:35 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00025: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:10:35 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:35 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00042: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: small.test is 2.000000 >03/25/14 14:10:35 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:10:35 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00063: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: test is 3.000000 >03/25/14 14:10:35 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:10:35 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00081: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:10:35 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:35 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00101: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: undef is 1.000000 >03/25/14 14:10:35 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:35 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:35 Request 00001.00125: >03/25/14 14:10:35 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:35 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:10:35 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:35 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:10:35 Sending SEND_JOB_INFO/eom >03/25/14 14:10:35 Getting reply from schedd ... >03/25/14 14:10:35 Got NO_MORE_JOBS; done negotiating >03/25/14 14:10:35 This submitter hit its submitterLimit. >03/25/14 14:10:35 resources used scheddUsed= 30.000000 >03/25/14 14:10:35 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:10:35 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:10:35 Getting monitoring info for pid 22893 >03/25/14 14:10:36 Getting monitoring info for pid 22893 >03/25/14 14:10:37 Getting monitoring info for pid 22893 >03/25/14 14:10:38 Getting monitoring info for pid 22893 >03/25/14 14:10:39 Getting monitoring info for pid 22893 >03/25/14 14:10:40 Getting monitoring info for pid 22893 >03/25/14 14:10:41 Getting monitoring info for pid 22893 >03/25/14 14:10:42 Getting monitoring info for pid 22893 >03/25/14 14:10:43 Getting monitoring info for pid 22893 >03/25/14 14:10:44 Getting monitoring info for pid 22893 >03/25/14 14:10:45 Getting monitoring info for pid 22893 >03/25/14 14:10:46 Getting monitoring info for pid 22893 >03/25/14 14:10:47 Getting monitoring info for pid 22893 >03/25/14 14:10:48 Getting monitoring info for pid 22893 >03/25/14 14:10:49 Getting monitoring info for pid 22893 >03/25/14 14:10:50 Getting monitoring info for pid 22893 >03/25/14 14:10:51 Getting monitoring info for pid 22893 >03/25/14 14:10:52 Getting monitoring info for pid 22893 >03/25/14 14:10:53 Getting monitoring info for pid 22893 >03/25/14 14:10:54 Getting monitoring info for pid 22893 >03/25/14 14:10:55 ---------- Started Negotiation Cycle ---------- >03/25/14 14:10:55 Phase 1: Obtaining ads from collector ... >03/25/14 14:10:55 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:10:55 Trying to query collector <IP:9618> >03/25/14 14:10:55 Sorting 32 ads ... >03/25/14 14:10:55 Getting startd private ads ... >03/25/14 14:10:55 Trying to query collector <IP:9618> >03/25/14 14:10:55 Got ads: 32 public and 30 private >03/25/14 14:10:55 Public ads include 1 submitter, 30 startd >03/25/14 14:10:55 Phase 2: Performing accounting ... >03/25/14 14:10:55 Entering compute_significant_attrs() >03/25/14 14:10:55 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:10:55 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:10:55 CustomerName=Customer.<none> , Old Priority=0.776 , New Priority=0.781 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:55 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=35745.000 (unweighted 35745.000), BeginUsageTime=1395751882 >03/25/14 14:10:55 CustomerName=Customer.test@<hostname> , Old Priority=0.776 , New Priority=0.781 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:10:55 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=35745.000 (unweighted 35745.000), BeginUsageTime=1395751882 >03/25/14 14:10:56 (Accountant) Checking Matches >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:10:56 Match already existed! >03/25/14 14:10:56 Previous Limits -- >03/25/14 14:10:56 Limit: test = 3.000000 >03/25/14 14:10:56 Limit: small.test = 2.000000 >03/25/14 14:10:56 Limit: medium.test = 5.000000 >03/25/14 14:10:56 Limit: undef.test = 1.000000 >03/25/14 14:10:56 Limit: undef = 1.000000 >03/25/14 14:10:56 Limit: large.test = 13.000000 >03/25/14 14:10:56 Limit: medium.undef = 5.000000 >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(medium.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(medium.undef) >03/25/14 14:10:56 IncrementLimit(small.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(medium.undef) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(medium.undef) >03/25/14 14:10:56 IncrementLimit(medium.undef) >03/25/14 14:10:56 IncrementLimit(medium.undef) >03/25/14 14:10:56 IncrementLimit(small.test) >03/25/14 14:10:56 IncrementLimit(test) >03/25/14 14:10:56 IncrementLimit(medium.test) >03/25/14 14:10:56 IncrementLimit(test) >03/25/14 14:10:56 IncrementLimit(medium.test) >03/25/14 14:10:56 IncrementLimit(test) >03/25/14 14:10:56 IncrementLimit(medium.test) >03/25/14 14:10:56 IncrementLimit(undef.test) >03/25/14 14:10:56 IncrementLimit(medium.test) >03/25/14 14:10:56 IncrementLimit(undef) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 IncrementLimit(large.test) >03/25/14 14:10:56 Current Limits -- >03/25/14 14:10:56 Limit: test = 3.000000 >03/25/14 14:10:56 Limit: small.test = 2.000000 >03/25/14 14:10:56 Limit: medium.test = 5.000000 >03/25/14 14:10:56 Limit: undef.test = 1.000000 >03/25/14 14:10:56 Limit: undef = 1.000000 >03/25/14 14:10:56 Limit: large.test = 13.000000 >03/25/14 14:10:56 Limit: medium.undef = 5.000000 >03/25/14 14:10:56 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:10:56 Phase 4.1: Negotiating with schedds ... >03/25/14 14:10:56 numSlots = 30 >03/25/14 14:10:56 slotWeightTotal = 30.000000 >03/25/14 14:10:56 pieLeft = 0.000 >03/25/14 14:10:56 NormalFactor = 1.000000 >03/25/14 14:10:56 MaxPrioValue = 0.780646 >03/25/14 14:10:56 NumSubmitterAds = 1 >03/25/14 14:10:56 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:10:56 0 seconds so far >03/25/14 14:10:56 Calculating submitter limit with the following parameters >03/25/14 14:10:56 SubmitterPrio = 0.780646 >03/25/14 14:10:56 SubmitterPrioFactor = 1.000000 >03/25/14 14:10:56 submitterShare = 1.000000 >03/25/14 14:10:56 submitterAbsShare = 1.000000 >03/25/14 14:10:56 submitterLimit = 0.000000 >03/25/14 14:10:56 submitterUsage = 30.000000 >03/25/14 14:10:56 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:10:56 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00011: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: large.test is 13.000000 >03/25/14 14:10:56 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:10:56 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00025: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:10:56 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:56 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00042: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: small.test is 2.000000 >03/25/14 14:10:56 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:10:56 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00063: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: test is 3.000000 >03/25/14 14:10:56 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:10:56 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00081: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:10:56 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:56 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00101: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: undef is 1.000000 >03/25/14 14:10:56 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:10:56 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:10:56 Request 00001.00125: >03/25/14 14:10:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:10:56 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:10:56 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:10:56 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:10:56 Sending SEND_JOB_INFO/eom >03/25/14 14:10:56 Getting reply from schedd ... >03/25/14 14:10:56 Got NO_MORE_JOBS; done negotiating >03/25/14 14:10:56 This submitter hit its submitterLimit. >03/25/14 14:10:56 resources used scheddUsed= 30.000000 >03/25/14 14:10:56 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:10:56 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:10:56 Getting monitoring info for pid 22893 >03/25/14 14:10:57 Getting monitoring info for pid 22893 >03/25/14 14:10:58 Getting monitoring info for pid 22893 >03/25/14 14:10:59 Getting monitoring info for pid 22893 >03/25/14 14:11:00 Getting monitoring info for pid 22893 >03/25/14 14:11:01 Getting monitoring info for pid 22893 >03/25/14 14:11:02 Getting monitoring info for pid 22893 >03/25/14 14:11:03 Getting monitoring info for pid 22893 >03/25/14 14:11:04 Getting monitoring info for pid 22893 >03/25/14 14:11:05 Getting monitoring info for pid 22893 >03/25/14 14:11:06 Getting monitoring info for pid 22893 >03/25/14 14:11:07 Getting monitoring info for pid 22893 >03/25/14 14:11:08 Getting monitoring info for pid 22893 >03/25/14 14:11:09 Getting monitoring info for pid 22893 >03/25/14 14:11:10 Getting monitoring info for pid 22893 >03/25/14 14:11:11 Getting monitoring info for pid 22893 >03/25/14 14:11:12 Getting monitoring info for pid 22893 >03/25/14 14:11:13 Getting monitoring info for pid 22893 >03/25/14 14:11:14 Getting monitoring info for pid 22893 >03/25/14 14:11:15 Getting monitoring info for pid 22893 >03/25/14 14:11:16 ---------- Started Negotiation Cycle ---------- >03/25/14 14:11:16 Phase 1: Obtaining ads from collector ... >03/25/14 14:11:16 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:11:16 Trying to query collector <IP:9618> >03/25/14 14:11:16 Sorting 32 ads ... >03/25/14 14:11:16 Getting startd private ads ... >03/25/14 14:11:16 Trying to query collector <IP:9618> >03/25/14 14:11:16 Got ads: 32 public and 30 private >03/25/14 14:11:16 Public ads include 1 submitter, 30 startd >03/25/14 14:11:16 Phase 2: Performing accounting ... >03/25/14 14:11:16 Entering compute_significant_attrs() >03/25/14 14:11:16 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:11:16 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:11:16 CustomerName=Customer.<none> , Old Priority=0.781 , New Priority=0.786 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:16 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=36375.000 (unweighted 36375.000), BeginUsageTime=1395751882 >03/25/14 14:11:16 CustomerName=Customer.test@<hostname> , Old Priority=0.781 , New Priority=0.786 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:16 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=36375.000 (unweighted 36375.000), BeginUsageTime=1395751882 >03/25/14 14:11:16 (Accountant) Checking Matches >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:11:16 Match already existed! >03/25/14 14:11:16 Previous Limits -- >03/25/14 14:11:16 Limit: test = 3.000000 >03/25/14 14:11:16 Limit: small.test = 2.000000 >03/25/14 14:11:16 Limit: medium.test = 5.000000 >03/25/14 14:11:16 Limit: undef.test = 1.000000 >03/25/14 14:11:16 Limit: undef = 1.000000 >03/25/14 14:11:16 Limit: large.test = 13.000000 >03/25/14 14:11:16 Limit: medium.undef = 5.000000 >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(medium.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(medium.undef) >03/25/14 14:11:16 IncrementLimit(small.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(medium.undef) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(medium.undef) >03/25/14 14:11:16 IncrementLimit(medium.undef) >03/25/14 14:11:16 IncrementLimit(medium.undef) >03/25/14 14:11:16 IncrementLimit(small.test) >03/25/14 14:11:16 IncrementLimit(test) >03/25/14 14:11:16 IncrementLimit(medium.test) >03/25/14 14:11:16 IncrementLimit(test) >03/25/14 14:11:16 IncrementLimit(medium.test) >03/25/14 14:11:16 IncrementLimit(test) >03/25/14 14:11:16 IncrementLimit(medium.test) >03/25/14 14:11:16 IncrementLimit(undef.test) >03/25/14 14:11:16 IncrementLimit(medium.test) >03/25/14 14:11:16 IncrementLimit(undef) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 IncrementLimit(large.test) >03/25/14 14:11:16 Current Limits -- >03/25/14 14:11:16 Limit: test = 3.000000 >03/25/14 14:11:16 Limit: small.test = 2.000000 >03/25/14 14:11:16 Limit: medium.test = 5.000000 >03/25/14 14:11:16 Limit: undef.test = 1.000000 >03/25/14 14:11:16 Limit: undef = 1.000000 >03/25/14 14:11:16 Limit: large.test = 13.000000 >03/25/14 14:11:16 Limit: medium.undef = 5.000000 >03/25/14 14:11:16 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:11:16 Phase 4.1: Negotiating with schedds ... >03/25/14 14:11:16 numSlots = 30 >03/25/14 14:11:16 slotWeightTotal = 30.000000 >03/25/14 14:11:16 pieLeft = 0.000 >03/25/14 14:11:16 NormalFactor = 1.000000 >03/25/14 14:11:16 MaxPrioValue = 0.785568 >03/25/14 14:11:16 NumSubmitterAds = 1 >03/25/14 14:11:16 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:11:16 0 seconds so far >03/25/14 14:11:16 Calculating submitter limit with the following parameters >03/25/14 14:11:16 SubmitterPrio = 0.785568 >03/25/14 14:11:16 SubmitterPrioFactor = 1.000000 >03/25/14 14:11:16 submitterShare = 1.000000 >03/25/14 14:11:16 submitterAbsShare = 1.000000 >03/25/14 14:11:16 submitterLimit = 0.000000 >03/25/14 14:11:16 submitterUsage = 30.000000 >03/25/14 14:11:16 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:11:16 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00011: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: large.test is 13.000000 >03/25/14 14:11:16 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:11:16 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00025: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:11:16 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:16 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00042: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: small.test is 2.000000 >03/25/14 14:11:16 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:11:16 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00063: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: test is 3.000000 >03/25/14 14:11:16 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:11:16 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00081: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:11:16 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:16 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00101: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: undef is 1.000000 >03/25/14 14:11:16 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:16 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:16 Request 00001.00125: >03/25/14 14:11:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:16 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:11:16 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:16 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:11:16 Sending SEND_JOB_INFO/eom >03/25/14 14:11:16 Getting reply from schedd ... >03/25/14 14:11:16 Got NO_MORE_JOBS; done negotiating >03/25/14 14:11:16 This submitter hit its submitterLimit. >03/25/14 14:11:16 resources used scheddUsed= 30.000000 >03/25/14 14:11:16 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:11:16 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:11:16 Getting monitoring info for pid 22893 >03/25/14 14:11:17 Getting monitoring info for pid 22893 >03/25/14 14:11:18 Getting monitoring info for pid 22893 >03/25/14 14:11:19 Getting monitoring info for pid 22893 >03/25/14 14:11:20 Getting monitoring info for pid 22893 >03/25/14 14:11:21 Getting monitoring info for pid 22893 >03/25/14 14:11:22 Getting monitoring info for pid 22893 >03/25/14 14:11:23 Getting monitoring info for pid 22893 >03/25/14 14:11:24 Getting monitoring info for pid 22893 >03/25/14 14:11:25 Getting monitoring info for pid 22893 >03/25/14 14:11:26 Getting monitoring info for pid 22893 >03/25/14 14:11:27 Getting monitoring info for pid 22893 >03/25/14 14:11:28 Getting monitoring info for pid 22893 >03/25/14 14:11:29 Getting monitoring info for pid 22893 >03/25/14 14:11:30 Getting monitoring info for pid 22893 >03/25/14 14:11:31 Getting monitoring info for pid 22893 >03/25/14 14:11:32 Getting monitoring info for pid 22893 >03/25/14 14:11:33 Getting monitoring info for pid 22893 >03/25/14 14:11:34 Getting monitoring info for pid 22893 >03/25/14 14:11:35 Getting monitoring info for pid 22893 >03/25/14 14:11:36 ---------- Started Negotiation Cycle ---------- >03/25/14 14:11:36 Phase 1: Obtaining ads from collector ... >03/25/14 14:11:36 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:11:36 Trying to query collector <IP:9618> >03/25/14 14:11:36 Sorting 32 ads ... >03/25/14 14:11:36 Getting startd private ads ... >03/25/14 14:11:36 Trying to query collector <IP:9618> >03/25/14 14:11:36 Got ads: 32 public and 30 private >03/25/14 14:11:36 Public ads include 1 submitter, 30 startd >03/25/14 14:11:36 Phase 2: Performing accounting ... >03/25/14 14:11:36 Entering compute_significant_attrs() >03/25/14 14:11:36 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:11:36 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:11:36 CustomerName=Customer.<none> , Old Priority=0.786 , New Priority=0.790 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:36 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=36975.000 (unweighted 36975.000), BeginUsageTime=1395751882 >03/25/14 14:11:36 CustomerName=Customer.test@<hostname> , Old Priority=0.786 , New Priority=0.790 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:36 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=36975.000 (unweighted 36975.000), BeginUsageTime=1395751882 >03/25/14 14:11:36 (Accountant) Checking Matches >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:11:36 Match already existed! >03/25/14 14:11:36 Previous Limits -- >03/25/14 14:11:36 Limit: test = 3.000000 >03/25/14 14:11:36 Limit: small.test = 2.000000 >03/25/14 14:11:36 Limit: medium.test = 5.000000 >03/25/14 14:11:36 Limit: undef.test = 1.000000 >03/25/14 14:11:36 Limit: undef = 1.000000 >03/25/14 14:11:36 Limit: large.test = 13.000000 >03/25/14 14:11:36 Limit: medium.undef = 5.000000 >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(medium.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(medium.undef) >03/25/14 14:11:36 IncrementLimit(small.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(medium.undef) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(medium.undef) >03/25/14 14:11:36 IncrementLimit(medium.undef) >03/25/14 14:11:36 IncrementLimit(medium.undef) >03/25/14 14:11:36 IncrementLimit(small.test) >03/25/14 14:11:36 IncrementLimit(test) >03/25/14 14:11:36 IncrementLimit(medium.test) >03/25/14 14:11:36 IncrementLimit(test) >03/25/14 14:11:36 IncrementLimit(medium.test) >03/25/14 14:11:36 IncrementLimit(test) >03/25/14 14:11:36 IncrementLimit(medium.test) >03/25/14 14:11:36 IncrementLimit(undef.test) >03/25/14 14:11:36 IncrementLimit(medium.test) >03/25/14 14:11:36 IncrementLimit(undef) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 IncrementLimit(large.test) >03/25/14 14:11:36 Current Limits -- >03/25/14 14:11:36 Limit: test = 3.000000 >03/25/14 14:11:36 Limit: small.test = 2.000000 >03/25/14 14:11:36 Limit: medium.test = 5.000000 >03/25/14 14:11:36 Limit: undef.test = 1.000000 >03/25/14 14:11:36 Limit: undef = 1.000000 >03/25/14 14:11:36 Limit: large.test = 13.000000 >03/25/14 14:11:36 Limit: medium.undef = 5.000000 >03/25/14 14:11:36 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:11:36 Phase 4.1: Negotiating with schedds ... >03/25/14 14:11:36 numSlots = 30 >03/25/14 14:11:36 slotWeightTotal = 30.000000 >03/25/14 14:11:36 pieLeft = 0.000 >03/25/14 14:11:36 NormalFactor = 1.000000 >03/25/14 14:11:36 MaxPrioValue = 0.790256 >03/25/14 14:11:36 NumSubmitterAds = 1 >03/25/14 14:11:36 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:11:36 0 seconds so far >03/25/14 14:11:36 Calculating submitter limit with the following parameters >03/25/14 14:11:36 SubmitterPrio = 0.790256 >03/25/14 14:11:36 SubmitterPrioFactor = 1.000000 >03/25/14 14:11:36 submitterShare = 1.000000 >03/25/14 14:11:36 submitterAbsShare = 1.000000 >03/25/14 14:11:36 submitterLimit = 0.000000 >03/25/14 14:11:36 submitterUsage = 30.000000 >03/25/14 14:11:36 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:11:36 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00011: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: large.test is 13.000000 >03/25/14 14:11:36 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:11:36 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00025: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:11:36 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:36 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00042: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: small.test is 2.000000 >03/25/14 14:11:36 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:11:36 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00063: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: test is 3.000000 >03/25/14 14:11:36 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:11:36 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00081: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:11:36 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:36 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00101: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: undef is 1.000000 >03/25/14 14:11:36 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:36 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:36 Request 00001.00125: >03/25/14 14:11:36 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:36 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:11:36 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:36 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:11:36 Sending SEND_JOB_INFO/eom >03/25/14 14:11:36 Getting reply from schedd ... >03/25/14 14:11:36 Got NO_MORE_JOBS; done negotiating >03/25/14 14:11:36 This submitter hit its submitterLimit. >03/25/14 14:11:36 resources used scheddUsed= 30.000000 >03/25/14 14:11:36 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:11:36 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:11:36 Getting monitoring info for pid 22893 >03/25/14 14:11:37 Getting monitoring info for pid 22893 >03/25/14 14:11:38 Getting monitoring info for pid 22893 >03/25/14 14:11:39 Getting monitoring info for pid 22893 >03/25/14 14:11:40 Getting monitoring info for pid 22893 >03/25/14 14:11:41 Getting monitoring info for pid 22893 >03/25/14 14:11:42 Getting monitoring info for pid 22893 >03/25/14 14:11:43 Getting monitoring info for pid 22893 >03/25/14 14:11:44 Getting monitoring info for pid 22893 >03/25/14 14:11:45 Getting monitoring info for pid 22893 >03/25/14 14:11:46 Getting monitoring info for pid 22893 >03/25/14 14:11:47 Getting monitoring info for pid 22893 >03/25/14 14:11:48 Getting monitoring info for pid 22893 >03/25/14 14:11:49 Getting monitoring info for pid 22893 >03/25/14 14:11:50 Getting monitoring info for pid 22893 >03/25/14 14:11:51 Getting monitoring info for pid 22893 >03/25/14 14:11:52 Getting monitoring info for pid 22893 >03/25/14 14:11:53 Getting monitoring info for pid 22893 >03/25/14 14:11:54 Getting monitoring info for pid 22893 >03/25/14 14:11:55 Getting monitoring info for pid 22893 >03/25/14 14:11:56 ---------- Started Negotiation Cycle ---------- >03/25/14 14:11:56 Phase 1: Obtaining ads from collector ... >03/25/14 14:11:56 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:11:56 Trying to query collector <IP:9618> >03/25/14 14:11:56 Sorting 32 ads ... >03/25/14 14:11:56 Getting startd private ads ... >03/25/14 14:11:56 Trying to query collector <IP:9618> >03/25/14 14:11:56 Got ads: 32 public and 30 private >03/25/14 14:11:56 Public ads include 1 submitter, 30 startd >03/25/14 14:11:56 Phase 2: Performing accounting ... >03/25/14 14:11:56 Entering compute_significant_attrs() >03/25/14 14:11:56 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:11:56 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:11:56 CustomerName=Customer.<none> , Old Priority=0.790 , New Priority=0.795 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:56 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=37575.000 (unweighted 37575.000), BeginUsageTime=1395751882 >03/25/14 14:11:56 CustomerName=Customer.test@<hostname> , Old Priority=0.790 , New Priority=0.795 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:11:56 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=37575.000 (unweighted 37575.000), BeginUsageTime=1395751882 >03/25/14 14:11:56 (Accountant) Checking Matches >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:11:56 Match already existed! >03/25/14 14:11:56 Previous Limits -- >03/25/14 14:11:56 Limit: test = 3.000000 >03/25/14 14:11:56 Limit: small.test = 2.000000 >03/25/14 14:11:56 Limit: medium.test = 5.000000 >03/25/14 14:11:56 Limit: undef.test = 1.000000 >03/25/14 14:11:56 Limit: undef = 1.000000 >03/25/14 14:11:56 Limit: large.test = 13.000000 >03/25/14 14:11:56 Limit: medium.undef = 5.000000 >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(medium.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(medium.undef) >03/25/14 14:11:56 IncrementLimit(small.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(medium.undef) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(medium.undef) >03/25/14 14:11:56 IncrementLimit(medium.undef) >03/25/14 14:11:56 IncrementLimit(medium.undef) >03/25/14 14:11:56 IncrementLimit(small.test) >03/25/14 14:11:56 IncrementLimit(test) >03/25/14 14:11:56 IncrementLimit(medium.test) >03/25/14 14:11:56 IncrementLimit(test) >03/25/14 14:11:56 IncrementLimit(medium.test) >03/25/14 14:11:56 IncrementLimit(test) >03/25/14 14:11:56 IncrementLimit(medium.test) >03/25/14 14:11:56 IncrementLimit(undef.test) >03/25/14 14:11:56 IncrementLimit(medium.test) >03/25/14 14:11:56 IncrementLimit(undef) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 IncrementLimit(large.test) >03/25/14 14:11:56 Current Limits -- >03/25/14 14:11:56 Limit: test = 3.000000 >03/25/14 14:11:56 Limit: small.test = 2.000000 >03/25/14 14:11:56 Limit: medium.test = 5.000000 >03/25/14 14:11:56 Limit: undef.test = 1.000000 >03/25/14 14:11:56 Limit: undef = 1.000000 >03/25/14 14:11:56 Limit: large.test = 13.000000 >03/25/14 14:11:56 Limit: medium.undef = 5.000000 >03/25/14 14:11:56 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:11:56 Phase 4.1: Negotiating with schedds ... >03/25/14 14:11:56 numSlots = 30 >03/25/14 14:11:56 slotWeightTotal = 30.000000 >03/25/14 14:11:56 pieLeft = 0.000 >03/25/14 14:11:56 NormalFactor = 1.000000 >03/25/14 14:11:56 MaxPrioValue = 0.794943 >03/25/14 14:11:56 NumSubmitterAds = 1 >03/25/14 14:11:56 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:11:56 0 seconds so far >03/25/14 14:11:56 Calculating submitter limit with the following parameters >03/25/14 14:11:56 SubmitterPrio = 0.794943 >03/25/14 14:11:56 SubmitterPrioFactor = 1.000000 >03/25/14 14:11:56 submitterShare = 1.000000 >03/25/14 14:11:56 submitterAbsShare = 1.000000 >03/25/14 14:11:56 submitterLimit = 0.000000 >03/25/14 14:11:56 submitterUsage = 30.000000 >03/25/14 14:11:56 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:11:56 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00011: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: large.test is 13.000000 >03/25/14 14:11:56 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:11:56 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00025: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:11:56 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:56 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00042: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: small.test is 2.000000 >03/25/14 14:11:56 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:11:56 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00063: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: test is 3.000000 >03/25/14 14:11:56 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:11:56 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00081: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:11:56 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:56 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00101: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: undef is 1.000000 >03/25/14 14:11:56 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:11:56 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got JOB_INFO command; getting classad/eom >03/25/14 14:11:56 Request 00001.00125: >03/25/14 14:11:56 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:11:56 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:11:56 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:11:56 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:11:56 Sending SEND_JOB_INFO/eom >03/25/14 14:11:56 Getting reply from schedd ... >03/25/14 14:11:56 Got NO_MORE_JOBS; done negotiating >03/25/14 14:11:56 This submitter hit its submitterLimit. >03/25/14 14:11:56 resources used scheddUsed= 30.000000 >03/25/14 14:11:56 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:11:56 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:11:56 Getting monitoring info for pid 22893 >03/25/14 14:11:57 Getting monitoring info for pid 22893 >03/25/14 14:11:58 Getting monitoring info for pid 22893 >03/25/14 14:11:59 Getting monitoring info for pid 22893 >03/25/14 14:12:00 Getting monitoring info for pid 22893 >03/25/14 14:12:01 Getting monitoring info for pid 22893 >03/25/14 14:12:02 Getting monitoring info for pid 22893 >03/25/14 14:12:03 Getting monitoring info for pid 22893 >03/25/14 14:12:04 Getting monitoring info for pid 22893 >03/25/14 14:12:05 Getting monitoring info for pid 22893 >03/25/14 14:12:06 Getting monitoring info for pid 22893 >03/25/14 14:12:07 Getting monitoring info for pid 22893 >03/25/14 14:12:08 Getting monitoring info for pid 22893 >03/25/14 14:12:09 Getting monitoring info for pid 22893 >03/25/14 14:12:10 Getting monitoring info for pid 22893 >03/25/14 14:12:11 Getting monitoring info for pid 22893 >03/25/14 14:12:12 Getting monitoring info for pid 22893 >03/25/14 14:12:13 Getting monitoring info for pid 22893 >03/25/14 14:12:14 Getting monitoring info for pid 22893 >03/25/14 14:12:15 Getting monitoring info for pid 22893 >03/25/14 14:12:16 ---------- Started Negotiation Cycle ---------- >03/25/14 14:12:16 Phase 1: Obtaining ads from collector ... >03/25/14 14:12:16 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:12:16 Trying to query collector <IP:9618> >03/25/14 14:12:16 Sorting 32 ads ... >03/25/14 14:12:16 Getting startd private ads ... >03/25/14 14:12:16 Trying to query collector <IP:9618> >03/25/14 14:12:16 Got ads: 32 public and 30 private >03/25/14 14:12:16 Public ads include 1 submitter, 30 startd >03/25/14 14:12:16 Phase 2: Performing accounting ... >03/25/14 14:12:16 Entering compute_significant_attrs() >03/25/14 14:12:16 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:12:16 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:12:16 CustomerName=Customer.<none> , Old Priority=0.795 , New Priority=0.800 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:16 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=38175.000 (unweighted 38175.000), BeginUsageTime=1395751882 >03/25/14 14:12:16 CustomerName=Customer.test@<hostname> , Old Priority=0.795 , New Priority=0.800 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:16 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=38175.000 (unweighted 38175.000), BeginUsageTime=1395751882 >03/25/14 14:12:16 (Accountant) Checking Matches >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:12:16 Match already existed! >03/25/14 14:12:16 Previous Limits -- >03/25/14 14:12:16 Limit: test = 3.000000 >03/25/14 14:12:16 Limit: small.test = 2.000000 >03/25/14 14:12:16 Limit: medium.test = 5.000000 >03/25/14 14:12:16 Limit: undef.test = 1.000000 >03/25/14 14:12:16 Limit: undef = 1.000000 >03/25/14 14:12:16 Limit: large.test = 13.000000 >03/25/14 14:12:16 Limit: medium.undef = 5.000000 >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(medium.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(medium.undef) >03/25/14 14:12:16 IncrementLimit(small.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(medium.undef) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(medium.undef) >03/25/14 14:12:16 IncrementLimit(medium.undef) >03/25/14 14:12:16 IncrementLimit(medium.undef) >03/25/14 14:12:16 IncrementLimit(small.test) >03/25/14 14:12:16 IncrementLimit(test) >03/25/14 14:12:16 IncrementLimit(medium.test) >03/25/14 14:12:16 IncrementLimit(test) >03/25/14 14:12:16 IncrementLimit(medium.test) >03/25/14 14:12:16 IncrementLimit(test) >03/25/14 14:12:16 IncrementLimit(medium.test) >03/25/14 14:12:16 IncrementLimit(undef.test) >03/25/14 14:12:16 IncrementLimit(medium.test) >03/25/14 14:12:16 IncrementLimit(undef) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 IncrementLimit(large.test) >03/25/14 14:12:16 Current Limits -- >03/25/14 14:12:16 Limit: test = 3.000000 >03/25/14 14:12:16 Limit: small.test = 2.000000 >03/25/14 14:12:16 Limit: medium.test = 5.000000 >03/25/14 14:12:16 Limit: undef.test = 1.000000 >03/25/14 14:12:16 Limit: undef = 1.000000 >03/25/14 14:12:16 Limit: large.test = 13.000000 >03/25/14 14:12:16 Limit: medium.undef = 5.000000 >03/25/14 14:12:16 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:12:16 Phase 4.1: Negotiating with schedds ... >03/25/14 14:12:16 numSlots = 30 >03/25/14 14:12:16 slotWeightTotal = 30.000000 >03/25/14 14:12:16 pieLeft = 0.000 >03/25/14 14:12:16 NormalFactor = 1.000000 >03/25/14 14:12:16 MaxPrioValue = 0.799629 >03/25/14 14:12:16 NumSubmitterAds = 1 >03/25/14 14:12:16 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:12:16 0 seconds so far >03/25/14 14:12:16 Calculating submitter limit with the following parameters >03/25/14 14:12:16 SubmitterPrio = 0.799629 >03/25/14 14:12:16 SubmitterPrioFactor = 1.000000 >03/25/14 14:12:16 submitterShare = 1.000000 >03/25/14 14:12:16 submitterAbsShare = 1.000000 >03/25/14 14:12:16 submitterLimit = 0.000000 >03/25/14 14:12:16 submitterUsage = 30.000000 >03/25/14 14:12:16 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:12:16 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00011: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: large.test is 13.000000 >03/25/14 14:12:16 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:12:16 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00025: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:12:16 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:16 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00042: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: small.test is 2.000000 >03/25/14 14:12:16 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:12:16 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00063: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: test is 3.000000 >03/25/14 14:12:16 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:12:16 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00081: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:12:16 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:16 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00101: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: undef is 1.000000 >03/25/14 14:12:16 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:16 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:16 Request 00001.00125: >03/25/14 14:12:16 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:16 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:12:16 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:16 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:12:16 Sending SEND_JOB_INFO/eom >03/25/14 14:12:16 Getting reply from schedd ... >03/25/14 14:12:16 Got NO_MORE_JOBS; done negotiating >03/25/14 14:12:16 This submitter hit its submitterLimit. >03/25/14 14:12:16 resources used scheddUsed= 30.000000 >03/25/14 14:12:16 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:12:16 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:12:16 Getting monitoring info for pid 22893 >03/25/14 14:12:17 Getting monitoring info for pid 22893 >03/25/14 14:12:18 Getting monitoring info for pid 22893 >03/25/14 14:12:19 Getting monitoring info for pid 22893 >03/25/14 14:12:20 Getting monitoring info for pid 22893 >03/25/14 14:12:21 Getting monitoring info for pid 22893 >03/25/14 14:12:22 Getting monitoring info for pid 22893 >03/25/14 14:12:23 Getting monitoring info for pid 22893 >03/25/14 14:12:24 Getting monitoring info for pid 22893 >03/25/14 14:12:25 Getting monitoring info for pid 22893 >03/25/14 14:12:26 Getting monitoring info for pid 22893 >03/25/14 14:12:27 Getting monitoring info for pid 22893 >03/25/14 14:12:28 Getting monitoring info for pid 22893 >03/25/14 14:12:29 Getting monitoring info for pid 22893 >03/25/14 14:12:30 Getting monitoring info for pid 22893 >03/25/14 14:12:31 Getting monitoring info for pid 22893 >03/25/14 14:12:32 Getting monitoring info for pid 22893 >03/25/14 14:12:33 Getting monitoring info for pid 22893 >03/25/14 14:12:34 Getting monitoring info for pid 22893 >03/25/14 14:12:35 Getting monitoring info for pid 22893 >03/25/14 14:12:36 ---------- Started Negotiation Cycle ---------- >03/25/14 14:12:36 Phase 1: Obtaining ads from collector ... >03/25/14 14:12:36 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:12:36 Trying to query collector <IP:9618> >03/25/14 14:12:36 Sorting 32 ads ... >03/25/14 14:12:36 Getting startd private ads ... >03/25/14 14:12:36 Trying to query collector <IP:9618> >03/25/14 14:12:36 Got ads: 32 public and 30 private >03/25/14 14:12:36 Public ads include 1 submitter, 30 startd >03/25/14 14:12:36 Phase 2: Performing accounting ... >03/25/14 14:12:36 Entering compute_significant_attrs() >03/25/14 14:12:36 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:12:37 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:12:37 CustomerName=Customer.<none> , Old Priority=0.800 , New Priority=0.804 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:37 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=38775.000 (unweighted 38775.000), BeginUsageTime=1395751882 >03/25/14 14:12:37 CustomerName=Customer.test@<hostname> , Old Priority=0.800 , New Priority=0.804 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:37 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=38775.000 (unweighted 38775.000), BeginUsageTime=1395751882 >03/25/14 14:12:37 (Accountant) Checking Matches >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:12:37 Match already existed! >03/25/14 14:12:37 Previous Limits -- >03/25/14 14:12:37 Limit: test = 3.000000 >03/25/14 14:12:37 Limit: small.test = 2.000000 >03/25/14 14:12:37 Limit: medium.test = 5.000000 >03/25/14 14:12:37 Limit: undef.test = 1.000000 >03/25/14 14:12:37 Limit: undef = 1.000000 >03/25/14 14:12:37 Limit: large.test = 13.000000 >03/25/14 14:12:37 Limit: medium.undef = 5.000000 >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(medium.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(medium.undef) >03/25/14 14:12:37 IncrementLimit(small.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(medium.undef) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(medium.undef) >03/25/14 14:12:37 IncrementLimit(medium.undef) >03/25/14 14:12:37 IncrementLimit(medium.undef) >03/25/14 14:12:37 IncrementLimit(small.test) >03/25/14 14:12:37 IncrementLimit(test) >03/25/14 14:12:37 IncrementLimit(medium.test) >03/25/14 14:12:37 IncrementLimit(test) >03/25/14 14:12:37 IncrementLimit(medium.test) >03/25/14 14:12:37 IncrementLimit(test) >03/25/14 14:12:37 IncrementLimit(medium.test) >03/25/14 14:12:37 IncrementLimit(undef.test) >03/25/14 14:12:37 IncrementLimit(medium.test) >03/25/14 14:12:37 IncrementLimit(undef) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 IncrementLimit(large.test) >03/25/14 14:12:37 Current Limits -- >03/25/14 14:12:37 Limit: test = 3.000000 >03/25/14 14:12:37 Limit: small.test = 2.000000 >03/25/14 14:12:37 Limit: medium.test = 5.000000 >03/25/14 14:12:37 Limit: undef.test = 1.000000 >03/25/14 14:12:37 Limit: undef = 1.000000 >03/25/14 14:12:37 Limit: large.test = 13.000000 >03/25/14 14:12:37 Limit: medium.undef = 5.000000 >03/25/14 14:12:37 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:12:37 Phase 4.1: Negotiating with schedds ... >03/25/14 14:12:37 numSlots = 30 >03/25/14 14:12:37 slotWeightTotal = 30.000000 >03/25/14 14:12:37 pieLeft = 0.000 >03/25/14 14:12:37 NormalFactor = 1.000000 >03/25/14 14:12:37 MaxPrioValue = 0.804314 >03/25/14 14:12:37 NumSubmitterAds = 1 >03/25/14 14:12:37 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:12:37 0 seconds so far >03/25/14 14:12:37 Calculating submitter limit with the following parameters >03/25/14 14:12:37 SubmitterPrio = 0.804314 >03/25/14 14:12:37 SubmitterPrioFactor = 1.000000 >03/25/14 14:12:37 submitterShare = 1.000000 >03/25/14 14:12:37 submitterAbsShare = 1.000000 >03/25/14 14:12:37 submitterLimit = 0.000000 >03/25/14 14:12:37 submitterUsage = 30.000000 >03/25/14 14:12:37 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:12:37 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00011: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: large.test is 13.000000 >03/25/14 14:12:37 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:12:37 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00025: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:12:37 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:37 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00042: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: small.test is 2.000000 >03/25/14 14:12:37 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:12:37 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00063: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: test is 3.000000 >03/25/14 14:12:37 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:12:37 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00081: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:12:37 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:37 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00101: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: undef is 1.000000 >03/25/14 14:12:37 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:37 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:37 Request 00001.00125: >03/25/14 14:12:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:37 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:12:37 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:37 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:12:37 Sending SEND_JOB_INFO/eom >03/25/14 14:12:37 Getting reply from schedd ... >03/25/14 14:12:37 Got NO_MORE_JOBS; done negotiating >03/25/14 14:12:37 This submitter hit its submitterLimit. >03/25/14 14:12:37 resources used scheddUsed= 30.000000 >03/25/14 14:12:37 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:12:37 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:12:37 Getting monitoring info for pid 22893 >03/25/14 14:12:38 Getting monitoring info for pid 22893 >03/25/14 14:12:39 Getting monitoring info for pid 22893 >03/25/14 14:12:40 Getting monitoring info for pid 22893 >03/25/14 14:12:41 Getting monitoring info for pid 22893 >03/25/14 14:12:42 Getting monitoring info for pid 22893 >03/25/14 14:12:43 Getting monitoring info for pid 22893 >03/25/14 14:12:44 Getting monitoring info for pid 22893 >03/25/14 14:12:45 Getting monitoring info for pid 22893 >03/25/14 14:12:46 Getting monitoring info for pid 22893 >03/25/14 14:12:47 Getting monitoring info for pid 22893 >03/25/14 14:12:48 Getting monitoring info for pid 22893 >03/25/14 14:12:49 Getting monitoring info for pid 22893 >03/25/14 14:12:50 Getting monitoring info for pid 22893 >03/25/14 14:12:51 Getting monitoring info for pid 22893 >03/25/14 14:12:52 Getting monitoring info for pid 22893 >03/25/14 14:12:53 Getting monitoring info for pid 22893 >03/25/14 14:12:54 Getting monitoring info for pid 22893 >03/25/14 14:12:55 Getting monitoring info for pid 22893 >03/25/14 14:12:56 Getting monitoring info for pid 22893 >03/25/14 14:12:57 ---------- Started Negotiation Cycle ---------- >03/25/14 14:12:57 Phase 1: Obtaining ads from collector ... >03/25/14 14:12:57 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:12:57 Trying to query collector <IP:9618> >03/25/14 14:12:57 Sorting 32 ads ... >03/25/14 14:12:57 Getting startd private ads ... >03/25/14 14:12:57 Trying to query collector <IP:9618> >03/25/14 14:12:57 Got ads: 32 public and 30 private >03/25/14 14:12:57 Public ads include 1 submitter, 30 startd >03/25/14 14:12:57 Phase 2: Performing accounting ... >03/25/14 14:12:57 Entering compute_significant_attrs() >03/25/14 14:12:57 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:12:57 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:12:57 CustomerName=Customer.<none> , Old Priority=0.804 , New Priority=0.809 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:57 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=39405.000 (unweighted 39405.000), BeginUsageTime=1395751882 >03/25/14 14:12:57 CustomerName=Customer.test@<hostname> , Old Priority=0.804 , New Priority=0.809 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:12:57 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=39405.000 (unweighted 39405.000), BeginUsageTime=1395751882 >03/25/14 14:12:57 (Accountant) Checking Matches >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:12:57 Match already existed! >03/25/14 14:12:57 Previous Limits -- >03/25/14 14:12:57 Limit: test = 3.000000 >03/25/14 14:12:57 Limit: small.test = 2.000000 >03/25/14 14:12:57 Limit: medium.test = 5.000000 >03/25/14 14:12:57 Limit: undef.test = 1.000000 >03/25/14 14:12:57 Limit: undef = 1.000000 >03/25/14 14:12:57 Limit: large.test = 13.000000 >03/25/14 14:12:57 Limit: medium.undef = 5.000000 >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(medium.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(medium.undef) >03/25/14 14:12:57 IncrementLimit(small.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(medium.undef) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(medium.undef) >03/25/14 14:12:57 IncrementLimit(medium.undef) >03/25/14 14:12:57 IncrementLimit(medium.undef) >03/25/14 14:12:57 IncrementLimit(small.test) >03/25/14 14:12:57 IncrementLimit(test) >03/25/14 14:12:57 IncrementLimit(medium.test) >03/25/14 14:12:57 IncrementLimit(test) >03/25/14 14:12:57 IncrementLimit(medium.test) >03/25/14 14:12:57 IncrementLimit(test) >03/25/14 14:12:57 IncrementLimit(medium.test) >03/25/14 14:12:57 IncrementLimit(undef.test) >03/25/14 14:12:57 IncrementLimit(medium.test) >03/25/14 14:12:57 IncrementLimit(undef) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 IncrementLimit(large.test) >03/25/14 14:12:57 Current Limits -- >03/25/14 14:12:57 Limit: test = 3.000000 >03/25/14 14:12:57 Limit: small.test = 2.000000 >03/25/14 14:12:57 Limit: medium.test = 5.000000 >03/25/14 14:12:57 Limit: undef.test = 1.000000 >03/25/14 14:12:57 Limit: undef = 1.000000 >03/25/14 14:12:57 Limit: large.test = 13.000000 >03/25/14 14:12:57 Limit: medium.undef = 5.000000 >03/25/14 14:12:57 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:12:57 Phase 4.1: Negotiating with schedds ... >03/25/14 14:12:57 numSlots = 30 >03/25/14 14:12:57 slotWeightTotal = 30.000000 >03/25/14 14:12:57 pieLeft = 0.000 >03/25/14 14:12:57 NormalFactor = 1.000000 >03/25/14 14:12:57 MaxPrioValue = 0.809232 >03/25/14 14:12:57 NumSubmitterAds = 1 >03/25/14 14:12:57 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:12:57 0 seconds so far >03/25/14 14:12:57 Calculating submitter limit with the following parameters >03/25/14 14:12:57 SubmitterPrio = 0.809232 >03/25/14 14:12:57 SubmitterPrioFactor = 1.000000 >03/25/14 14:12:57 submitterShare = 1.000000 >03/25/14 14:12:57 submitterAbsShare = 1.000000 >03/25/14 14:12:57 submitterLimit = 0.000000 >03/25/14 14:12:57 submitterUsage = 30.000000 >03/25/14 14:12:57 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:12:57 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00011: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: large.test is 13.000000 >03/25/14 14:12:57 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:12:57 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00025: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:12:57 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:57 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00042: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: small.test is 2.000000 >03/25/14 14:12:57 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:12:57 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00063: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: test is 3.000000 >03/25/14 14:12:57 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:12:57 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00081: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:12:57 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:57 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00101: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: undef is 1.000000 >03/25/14 14:12:57 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:12:57 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got JOB_INFO command; getting classad/eom >03/25/14 14:12:57 Request 00001.00125: >03/25/14 14:12:57 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:12:57 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:12:57 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:12:57 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:12:57 Sending SEND_JOB_INFO/eom >03/25/14 14:12:57 Getting reply from schedd ... >03/25/14 14:12:57 Got NO_MORE_JOBS; done negotiating >03/25/14 14:12:57 This submitter hit its submitterLimit. >03/25/14 14:12:57 resources used scheddUsed= 30.000000 >03/25/14 14:12:57 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:12:57 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:12:57 Getting monitoring info for pid 22893 >03/25/14 14:12:58 Getting monitoring info for pid 22893 >03/25/14 14:12:59 Getting monitoring info for pid 22893 >03/25/14 14:13:00 Getting monitoring info for pid 22893 >03/25/14 14:13:01 Getting monitoring info for pid 22893 >03/25/14 14:13:02 Getting monitoring info for pid 22893 >03/25/14 14:13:03 Getting monitoring info for pid 22893 >03/25/14 14:13:04 Getting monitoring info for pid 22893 >03/25/14 14:13:05 Getting monitoring info for pid 22893 >03/25/14 14:13:06 Getting monitoring info for pid 22893 >03/25/14 14:13:07 Getting monitoring info for pid 22893 >03/25/14 14:13:08 Getting monitoring info for pid 22893 >03/25/14 14:13:09 Getting monitoring info for pid 22893 >03/25/14 14:13:10 Getting monitoring info for pid 22893 >03/25/14 14:13:11 Getting monitoring info for pid 22893 >03/25/14 14:13:12 Getting monitoring info for pid 22893 >03/25/14 14:13:13 Getting monitoring info for pid 22893 >03/25/14 14:13:14 Getting monitoring info for pid 22893 >03/25/14 14:13:15 Getting monitoring info for pid 22893 >03/25/14 14:13:16 Getting monitoring info for pid 22893 >03/25/14 14:13:17 ---------- Started Negotiation Cycle ---------- >03/25/14 14:13:17 Phase 1: Obtaining ads from collector ... >03/25/14 14:13:17 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:13:17 Trying to query collector <IP:9618> >03/25/14 14:13:17 Sorting 32 ads ... >03/25/14 14:13:17 Getting startd private ads ... >03/25/14 14:13:17 Trying to query collector <IP:9618> >03/25/14 14:13:17 Got ads: 32 public and 30 private >03/25/14 14:13:17 Public ads include 1 submitter, 30 startd >03/25/14 14:13:17 Phase 2: Performing accounting ... >03/25/14 14:13:17 Entering compute_significant_attrs() >03/25/14 14:13:17 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:13:17 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:13:17 CustomerName=Customer.<none> , Old Priority=0.809 , New Priority=0.814 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:17 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=40005.000 (unweighted 40005.000), BeginUsageTime=1395751882 >03/25/14 14:13:17 CustomerName=Customer.test@<hostname> , Old Priority=0.809 , New Priority=0.814 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:17 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=40005.000 (unweighted 40005.000), BeginUsageTime=1395751882 >03/25/14 14:13:17 (Accountant) Checking Matches >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:13:17 Match already existed! >03/25/14 14:13:17 Previous Limits -- >03/25/14 14:13:17 Limit: test = 3.000000 >03/25/14 14:13:17 Limit: small.test = 2.000000 >03/25/14 14:13:17 Limit: medium.test = 5.000000 >03/25/14 14:13:17 Limit: undef.test = 1.000000 >03/25/14 14:13:17 Limit: undef = 1.000000 >03/25/14 14:13:17 Limit: large.test = 13.000000 >03/25/14 14:13:17 Limit: medium.undef = 5.000000 >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(medium.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(medium.undef) >03/25/14 14:13:17 IncrementLimit(small.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(medium.undef) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(medium.undef) >03/25/14 14:13:17 IncrementLimit(medium.undef) >03/25/14 14:13:17 IncrementLimit(medium.undef) >03/25/14 14:13:17 IncrementLimit(small.test) >03/25/14 14:13:17 IncrementLimit(test) >03/25/14 14:13:17 IncrementLimit(medium.test) >03/25/14 14:13:17 IncrementLimit(test) >03/25/14 14:13:17 IncrementLimit(medium.test) >03/25/14 14:13:17 IncrementLimit(test) >03/25/14 14:13:17 IncrementLimit(medium.test) >03/25/14 14:13:17 IncrementLimit(undef.test) >03/25/14 14:13:17 IncrementLimit(medium.test) >03/25/14 14:13:17 IncrementLimit(undef) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 IncrementLimit(large.test) >03/25/14 14:13:17 Current Limits -- >03/25/14 14:13:17 Limit: test = 3.000000 >03/25/14 14:13:17 Limit: small.test = 2.000000 >03/25/14 14:13:17 Limit: medium.test = 5.000000 >03/25/14 14:13:17 Limit: undef.test = 1.000000 >03/25/14 14:13:17 Limit: undef = 1.000000 >03/25/14 14:13:17 Limit: large.test = 13.000000 >03/25/14 14:13:17 Limit: medium.undef = 5.000000 >03/25/14 14:13:17 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:13:17 Phase 4.1: Negotiating with schedds ... >03/25/14 14:13:17 numSlots = 30 >03/25/14 14:13:17 slotWeightTotal = 30.000000 >03/25/14 14:13:17 pieLeft = 0.000 >03/25/14 14:13:17 NormalFactor = 1.000000 >03/25/14 14:13:17 MaxPrioValue = 0.813916 >03/25/14 14:13:17 NumSubmitterAds = 1 >03/25/14 14:13:17 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:13:17 0 seconds so far >03/25/14 14:13:17 Calculating submitter limit with the following parameters >03/25/14 14:13:17 SubmitterPrio = 0.813916 >03/25/14 14:13:17 SubmitterPrioFactor = 1.000000 >03/25/14 14:13:17 submitterShare = 1.000000 >03/25/14 14:13:17 submitterAbsShare = 1.000000 >03/25/14 14:13:17 submitterLimit = 0.000000 >03/25/14 14:13:17 submitterUsage = 30.000000 >03/25/14 14:13:17 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:13:17 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00011: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: large.test is 13.000000 >03/25/14 14:13:17 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:13:17 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00025: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:13:17 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:17 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00042: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: small.test is 2.000000 >03/25/14 14:13:17 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:13:17 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00063: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: test is 3.000000 >03/25/14 14:13:17 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:13:17 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00081: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:13:17 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:17 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00101: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: undef is 1.000000 >03/25/14 14:13:17 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:17 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:17 Request 00001.00125: >03/25/14 14:13:17 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:17 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:13:17 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:17 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:13:17 Sending SEND_JOB_INFO/eom >03/25/14 14:13:17 Getting reply from schedd ... >03/25/14 14:13:17 Got NO_MORE_JOBS; done negotiating >03/25/14 14:13:17 This submitter hit its submitterLimit. >03/25/14 14:13:17 resources used scheddUsed= 30.000000 >03/25/14 14:13:17 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:13:17 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:13:17 Getting monitoring info for pid 22893 >03/25/14 14:13:18 Getting monitoring info for pid 22893 >03/25/14 14:13:19 Getting monitoring info for pid 22893 >03/25/14 14:13:20 Getting monitoring info for pid 22893 >03/25/14 14:13:21 Getting monitoring info for pid 22893 >03/25/14 14:13:22 Getting monitoring info for pid 22893 >03/25/14 14:13:23 Getting monitoring info for pid 22893 >03/25/14 14:13:24 Getting monitoring info for pid 22893 >03/25/14 14:13:25 Getting monitoring info for pid 22893 >03/25/14 14:13:26 Getting monitoring info for pid 22893 >03/25/14 14:13:27 Getting monitoring info for pid 22893 >03/25/14 14:13:28 Getting monitoring info for pid 22893 >03/25/14 14:13:29 Getting monitoring info for pid 22893 >03/25/14 14:13:30 Getting monitoring info for pid 22893 >03/25/14 14:13:31 Getting monitoring info for pid 22893 >03/25/14 14:13:32 Getting monitoring info for pid 22893 >03/25/14 14:13:33 Getting monitoring info for pid 22893 >03/25/14 14:13:34 Getting monitoring info for pid 22893 >03/25/14 14:13:35 Getting monitoring info for pid 22893 >03/25/14 14:13:36 Getting monitoring info for pid 22893 >03/25/14 14:13:37 ---------- Started Negotiation Cycle ---------- >03/25/14 14:13:37 Phase 1: Obtaining ads from collector ... >03/25/14 14:13:37 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:13:37 Trying to query collector <IP:9618> >03/25/14 14:13:37 Sorting 32 ads ... >03/25/14 14:13:37 Getting startd private ads ... >03/25/14 14:13:37 Trying to query collector <IP:9618> >03/25/14 14:13:37 Got ads: 32 public and 30 private >03/25/14 14:13:37 Public ads include 1 submitter, 30 startd >03/25/14 14:13:37 Phase 2: Performing accounting ... >03/25/14 14:13:37 Entering compute_significant_attrs() >03/25/14 14:13:37 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:13:37 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:13:37 CustomerName=Customer.<none> , Old Priority=0.814 , New Priority=0.819 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:37 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=40605.000 (unweighted 40605.000), BeginUsageTime=1395751882 >03/25/14 14:13:37 CustomerName=Customer.test@<hostname> , Old Priority=0.814 , New Priority=0.819 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:37 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=40605.000 (unweighted 40605.000), BeginUsageTime=1395751882 >03/25/14 14:13:37 (Accountant) Checking Matches >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:13:37 Match already existed! >03/25/14 14:13:37 Previous Limits -- >03/25/14 14:13:37 Limit: test = 3.000000 >03/25/14 14:13:37 Limit: small.test = 2.000000 >03/25/14 14:13:37 Limit: medium.test = 5.000000 >03/25/14 14:13:37 Limit: undef.test = 1.000000 >03/25/14 14:13:37 Limit: undef = 1.000000 >03/25/14 14:13:37 Limit: large.test = 13.000000 >03/25/14 14:13:37 Limit: medium.undef = 5.000000 >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(medium.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(medium.undef) >03/25/14 14:13:37 IncrementLimit(small.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(medium.undef) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(medium.undef) >03/25/14 14:13:37 IncrementLimit(medium.undef) >03/25/14 14:13:37 IncrementLimit(medium.undef) >03/25/14 14:13:37 IncrementLimit(small.test) >03/25/14 14:13:37 IncrementLimit(test) >03/25/14 14:13:37 IncrementLimit(medium.test) >03/25/14 14:13:37 IncrementLimit(test) >03/25/14 14:13:37 IncrementLimit(medium.test) >03/25/14 14:13:37 IncrementLimit(test) >03/25/14 14:13:37 IncrementLimit(medium.test) >03/25/14 14:13:37 IncrementLimit(undef.test) >03/25/14 14:13:37 IncrementLimit(medium.test) >03/25/14 14:13:37 IncrementLimit(undef) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 IncrementLimit(large.test) >03/25/14 14:13:37 Current Limits -- >03/25/14 14:13:37 Limit: test = 3.000000 >03/25/14 14:13:37 Limit: small.test = 2.000000 >03/25/14 14:13:37 Limit: medium.test = 5.000000 >03/25/14 14:13:37 Limit: undef.test = 1.000000 >03/25/14 14:13:37 Limit: undef = 1.000000 >03/25/14 14:13:37 Limit: large.test = 13.000000 >03/25/14 14:13:37 Limit: medium.undef = 5.000000 >03/25/14 14:13:37 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:13:37 Phase 4.1: Negotiating with schedds ... >03/25/14 14:13:37 numSlots = 30 >03/25/14 14:13:37 slotWeightTotal = 30.000000 >03/25/14 14:13:37 pieLeft = 0.000 >03/25/14 14:13:37 NormalFactor = 1.000000 >03/25/14 14:13:37 MaxPrioValue = 0.818599 >03/25/14 14:13:37 NumSubmitterAds = 1 >03/25/14 14:13:37 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:13:37 0 seconds so far >03/25/14 14:13:37 Calculating submitter limit with the following parameters >03/25/14 14:13:37 SubmitterPrio = 0.818599 >03/25/14 14:13:37 SubmitterPrioFactor = 1.000000 >03/25/14 14:13:37 submitterShare = 1.000000 >03/25/14 14:13:37 submitterAbsShare = 1.000000 >03/25/14 14:13:37 submitterLimit = 0.000000 >03/25/14 14:13:37 submitterUsage = 30.000000 >03/25/14 14:13:37 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:13:37 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00011: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: large.test is 13.000000 >03/25/14 14:13:37 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:13:37 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00025: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:13:37 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:37 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00042: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: small.test is 2.000000 >03/25/14 14:13:37 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:13:37 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00063: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: test is 3.000000 >03/25/14 14:13:37 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:13:37 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00081: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:13:37 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:37 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00101: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: undef is 1.000000 >03/25/14 14:13:37 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:37 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:37 Request 00001.00125: >03/25/14 14:13:37 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:37 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:13:37 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:37 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:13:37 Sending SEND_JOB_INFO/eom >03/25/14 14:13:37 Getting reply from schedd ... >03/25/14 14:13:37 Got NO_MORE_JOBS; done negotiating >03/25/14 14:13:37 This submitter hit its submitterLimit. >03/25/14 14:13:37 resources used scheddUsed= 30.000000 >03/25/14 14:13:37 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:13:37 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:13:37 Getting monitoring info for pid 22893 >03/25/14 14:13:38 Getting monitoring info for pid 22893 >03/25/14 14:13:39 Getting monitoring info for pid 22893 >03/25/14 14:13:40 Getting monitoring info for pid 22893 >03/25/14 14:13:41 Getting monitoring info for pid 22893 >03/25/14 14:13:42 Getting monitoring info for pid 22893 >03/25/14 14:13:43 Getting monitoring info for pid 22893 >03/25/14 14:13:44 Getting monitoring info for pid 22893 >03/25/14 14:13:45 Getting monitoring info for pid 22893 >03/25/14 14:13:46 Getting monitoring info for pid 22893 >03/25/14 14:13:47 Getting monitoring info for pid 22893 >03/25/14 14:13:48 Getting monitoring info for pid 22893 >03/25/14 14:13:49 Getting monitoring info for pid 22893 >03/25/14 14:13:50 Getting monitoring info for pid 22893 >03/25/14 14:13:51 Getting monitoring info for pid 22893 >03/25/14 14:13:52 Getting monitoring info for pid 22893 >03/25/14 14:13:53 Getting monitoring info for pid 22893 >03/25/14 14:13:54 Getting monitoring info for pid 22893 >03/25/14 14:13:55 Getting monitoring info for pid 22893 >03/25/14 14:13:56 Getting monitoring info for pid 22893 >03/25/14 14:13:57 ---------- Started Negotiation Cycle ---------- >03/25/14 14:13:57 Phase 1: Obtaining ads from collector ... >03/25/14 14:13:57 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:13:57 Trying to query collector <IP:9618> >03/25/14 14:13:57 Sorting 32 ads ... >03/25/14 14:13:57 Getting startd private ads ... >03/25/14 14:13:57 Trying to query collector <IP:9618> >03/25/14 14:13:58 Got ads: 32 public and 30 private >03/25/14 14:13:58 Public ads include 1 submitter, 30 startd >03/25/14 14:13:58 Phase 2: Performing accounting ... >03/25/14 14:13:58 Entering compute_significant_attrs() >03/25/14 14:13:58 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:13:58 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:13:58 CustomerName=Customer.<none> , Old Priority=0.819 , New Priority=0.824 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:58 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=41235.000 (unweighted 41235.000), BeginUsageTime=1395751882 >03/25/14 14:13:58 CustomerName=Customer.test@<hostname> , Old Priority=0.819 , New Priority=0.824 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:13:58 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=41235.000 (unweighted 41235.000), BeginUsageTime=1395751882 >03/25/14 14:13:58 (Accountant) Checking Matches >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:13:58 Match already existed! >03/25/14 14:13:58 Previous Limits -- >03/25/14 14:13:58 Limit: test = 3.000000 >03/25/14 14:13:58 Limit: small.test = 2.000000 >03/25/14 14:13:58 Limit: medium.test = 5.000000 >03/25/14 14:13:58 Limit: undef.test = 1.000000 >03/25/14 14:13:58 Limit: undef = 1.000000 >03/25/14 14:13:58 Limit: large.test = 13.000000 >03/25/14 14:13:58 Limit: medium.undef = 5.000000 >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(medium.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(medium.undef) >03/25/14 14:13:58 IncrementLimit(small.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(medium.undef) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(medium.undef) >03/25/14 14:13:58 IncrementLimit(medium.undef) >03/25/14 14:13:58 IncrementLimit(medium.undef) >03/25/14 14:13:58 IncrementLimit(small.test) >03/25/14 14:13:58 IncrementLimit(test) >03/25/14 14:13:58 IncrementLimit(medium.test) >03/25/14 14:13:58 IncrementLimit(test) >03/25/14 14:13:58 IncrementLimit(medium.test) >03/25/14 14:13:58 IncrementLimit(test) >03/25/14 14:13:58 IncrementLimit(medium.test) >03/25/14 14:13:58 IncrementLimit(undef.test) >03/25/14 14:13:58 IncrementLimit(medium.test) >03/25/14 14:13:58 IncrementLimit(undef) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 IncrementLimit(large.test) >03/25/14 14:13:58 Current Limits -- >03/25/14 14:13:58 Limit: test = 3.000000 >03/25/14 14:13:58 Limit: small.test = 2.000000 >03/25/14 14:13:58 Limit: medium.test = 5.000000 >03/25/14 14:13:58 Limit: undef.test = 1.000000 >03/25/14 14:13:58 Limit: undef = 1.000000 >03/25/14 14:13:58 Limit: large.test = 13.000000 >03/25/14 14:13:58 Limit: medium.undef = 5.000000 >03/25/14 14:13:58 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:13:58 Phase 4.1: Negotiating with schedds ... >03/25/14 14:13:58 numSlots = 30 >03/25/14 14:13:58 slotWeightTotal = 30.000000 >03/25/14 14:13:58 pieLeft = 0.000 >03/25/14 14:13:58 NormalFactor = 1.000000 >03/25/14 14:13:58 MaxPrioValue = 0.823514 >03/25/14 14:13:58 NumSubmitterAds = 1 >03/25/14 14:13:58 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:13:58 0 seconds so far >03/25/14 14:13:58 Calculating submitter limit with the following parameters >03/25/14 14:13:58 SubmitterPrio = 0.823514 >03/25/14 14:13:58 SubmitterPrioFactor = 1.000000 >03/25/14 14:13:58 submitterShare = 1.000000 >03/25/14 14:13:58 submitterAbsShare = 1.000000 >03/25/14 14:13:58 submitterLimit = 0.000000 >03/25/14 14:13:58 submitterUsage = 30.000000 >03/25/14 14:13:58 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:13:58 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00011: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: large.test is 13.000000 >03/25/14 14:13:58 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:13:58 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00025: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:13:58 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:58 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00042: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: small.test is 2.000000 >03/25/14 14:13:58 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:13:58 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00063: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: test is 3.000000 >03/25/14 14:13:58 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:13:58 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00081: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:13:58 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:58 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00101: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: undef is 1.000000 >03/25/14 14:13:58 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:13:58 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got JOB_INFO command; getting classad/eom >03/25/14 14:13:58 Request 00001.00125: >03/25/14 14:13:58 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:13:58 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:13:58 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:13:58 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:13:58 Sending SEND_JOB_INFO/eom >03/25/14 14:13:58 Getting reply from schedd ... >03/25/14 14:13:58 Got NO_MORE_JOBS; done negotiating >03/25/14 14:13:58 This submitter hit its submitterLimit. >03/25/14 14:13:58 resources used scheddUsed= 30.000000 >03/25/14 14:13:58 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:13:58 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:13:58 Getting monitoring info for pid 22893 >03/25/14 14:13:59 Getting monitoring info for pid 22893 >03/25/14 14:14:00 Getting monitoring info for pid 22893 >03/25/14 14:14:01 Getting monitoring info for pid 22893 >03/25/14 14:14:02 Getting monitoring info for pid 22893 >03/25/14 14:14:03 Getting monitoring info for pid 22893 >03/25/14 14:14:04 Getting monitoring info for pid 22893 >03/25/14 14:14:05 Getting monitoring info for pid 22893 >03/25/14 14:14:06 Getting monitoring info for pid 22893 >03/25/14 14:14:07 Getting monitoring info for pid 22893 >03/25/14 14:14:08 Getting monitoring info for pid 22893 >03/25/14 14:14:09 Getting monitoring info for pid 22893 >03/25/14 14:14:10 Getting monitoring info for pid 22893 >03/25/14 14:14:11 Getting monitoring info for pid 22893 >03/25/14 14:14:12 Getting monitoring info for pid 22893 >03/25/14 14:14:13 Getting monitoring info for pid 22893 >03/25/14 14:14:14 Getting monitoring info for pid 22893 >03/25/14 14:14:15 Getting monitoring info for pid 22893 >03/25/14 14:14:16 Getting monitoring info for pid 22893 >03/25/14 14:14:17 Getting monitoring info for pid 22893 >03/25/14 14:14:18 ---------- Started Negotiation Cycle ---------- >03/25/14 14:14:18 Phase 1: Obtaining ads from collector ... >03/25/14 14:14:18 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:14:18 Trying to query collector <IP:9618> >03/25/14 14:14:18 Sorting 32 ads ... >03/25/14 14:14:18 Getting startd private ads ... >03/25/14 14:14:18 Trying to query collector <IP:9618> >03/25/14 14:14:18 Got ads: 32 public and 30 private >03/25/14 14:14:18 Public ads include 1 submitter, 30 startd >03/25/14 14:14:18 Phase 2: Performing accounting ... >03/25/14 14:14:18 Entering compute_significant_attrs() >03/25/14 14:14:18 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:14:18 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:14:18 CustomerName=Customer.<none> , Old Priority=0.824 , New Priority=0.828 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:18 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=41835.000 (unweighted 41835.000), BeginUsageTime=1395751882 >03/25/14 14:14:18 CustomerName=Customer.test@<hostname> , Old Priority=0.824 , New Priority=0.828 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:18 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=41835.000 (unweighted 41835.000), BeginUsageTime=1395751882 >03/25/14 14:14:18 (Accountant) Checking Matches >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:14:18 Match already existed! >03/25/14 14:14:18 Previous Limits -- >03/25/14 14:14:18 Limit: test = 3.000000 >03/25/14 14:14:18 Limit: small.test = 2.000000 >03/25/14 14:14:18 Limit: medium.test = 5.000000 >03/25/14 14:14:18 Limit: undef.test = 1.000000 >03/25/14 14:14:18 Limit: undef = 1.000000 >03/25/14 14:14:18 Limit: large.test = 13.000000 >03/25/14 14:14:18 Limit: medium.undef = 5.000000 >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(medium.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(medium.undef) >03/25/14 14:14:18 IncrementLimit(small.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(medium.undef) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(medium.undef) >03/25/14 14:14:18 IncrementLimit(medium.undef) >03/25/14 14:14:18 IncrementLimit(medium.undef) >03/25/14 14:14:18 IncrementLimit(small.test) >03/25/14 14:14:18 IncrementLimit(test) >03/25/14 14:14:18 IncrementLimit(medium.test) >03/25/14 14:14:18 IncrementLimit(test) >03/25/14 14:14:18 IncrementLimit(medium.test) >03/25/14 14:14:18 IncrementLimit(test) >03/25/14 14:14:18 IncrementLimit(medium.test) >03/25/14 14:14:18 IncrementLimit(undef.test) >03/25/14 14:14:18 IncrementLimit(medium.test) >03/25/14 14:14:18 IncrementLimit(undef) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 IncrementLimit(large.test) >03/25/14 14:14:18 Current Limits -- >03/25/14 14:14:18 Limit: test = 3.000000 >03/25/14 14:14:18 Limit: small.test = 2.000000 >03/25/14 14:14:18 Limit: medium.test = 5.000000 >03/25/14 14:14:18 Limit: undef.test = 1.000000 >03/25/14 14:14:18 Limit: undef = 1.000000 >03/25/14 14:14:18 Limit: large.test = 13.000000 >03/25/14 14:14:18 Limit: medium.undef = 5.000000 >03/25/14 14:14:18 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:14:18 Phase 4.1: Negotiating with schedds ... >03/25/14 14:14:18 numSlots = 30 >03/25/14 14:14:18 slotWeightTotal = 30.000000 >03/25/14 14:14:18 pieLeft = 0.000 >03/25/14 14:14:18 NormalFactor = 1.000000 >03/25/14 14:14:18 MaxPrioValue = 0.828196 >03/25/14 14:14:18 NumSubmitterAds = 1 >03/25/14 14:14:18 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:14:18 0 seconds so far >03/25/14 14:14:18 Calculating submitter limit with the following parameters >03/25/14 14:14:18 SubmitterPrio = 0.828196 >03/25/14 14:14:18 SubmitterPrioFactor = 1.000000 >03/25/14 14:14:18 submitterShare = 1.000000 >03/25/14 14:14:18 submitterAbsShare = 1.000000 >03/25/14 14:14:18 submitterLimit = 0.000000 >03/25/14 14:14:18 submitterUsage = 30.000000 >03/25/14 14:14:18 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:14:18 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00011: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: large.test is 13.000000 >03/25/14 14:14:18 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:14:18 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00025: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:14:18 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:18 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00042: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: small.test is 2.000000 >03/25/14 14:14:18 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:14:18 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00063: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: test is 3.000000 >03/25/14 14:14:18 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:14:18 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00081: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:14:18 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:18 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00101: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: undef is 1.000000 >03/25/14 14:14:18 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:18 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:18 Request 00001.00125: >03/25/14 14:14:18 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:18 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:14:18 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:18 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:14:18 Sending SEND_JOB_INFO/eom >03/25/14 14:14:18 Getting reply from schedd ... >03/25/14 14:14:18 Got NO_MORE_JOBS; done negotiating >03/25/14 14:14:18 This submitter hit its submitterLimit. >03/25/14 14:14:18 resources used scheddUsed= 30.000000 >03/25/14 14:14:18 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:14:18 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:14:18 Getting monitoring info for pid 22893 >03/25/14 14:14:19 Getting monitoring info for pid 22893 >03/25/14 14:14:20 Getting monitoring info for pid 22893 >03/25/14 14:14:21 Getting monitoring info for pid 22893 >03/25/14 14:14:22 Getting monitoring info for pid 22893 >03/25/14 14:14:23 Getting monitoring info for pid 22893 >03/25/14 14:14:24 Getting monitoring info for pid 22893 >03/25/14 14:14:25 Getting monitoring info for pid 22893 >03/25/14 14:14:26 Getting monitoring info for pid 22893 >03/25/14 14:14:27 Getting monitoring info for pid 22893 >03/25/14 14:14:28 Getting monitoring info for pid 22893 >03/25/14 14:14:29 Getting monitoring info for pid 22893 >03/25/14 14:14:30 Getting monitoring info for pid 22893 >03/25/14 14:14:31 Getting monitoring info for pid 22893 >03/25/14 14:14:32 Getting monitoring info for pid 22893 >03/25/14 14:14:33 Getting monitoring info for pid 22893 >03/25/14 14:14:34 Getting monitoring info for pid 22893 >03/25/14 14:14:35 Getting monitoring info for pid 22893 >03/25/14 14:14:36 Getting monitoring info for pid 22893 >03/25/14 14:14:37 Getting monitoring info for pid 22893 >03/25/14 14:14:38 ---------- Started Negotiation Cycle ---------- >03/25/14 14:14:38 Phase 1: Obtaining ads from collector ... >03/25/14 14:14:38 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:14:38 Trying to query collector <IP:9618> >03/25/14 14:14:38 Sorting 32 ads ... >03/25/14 14:14:38 Getting startd private ads ... >03/25/14 14:14:38 Trying to query collector <IP:9618> >03/25/14 14:14:38 Got ads: 32 public and 30 private >03/25/14 14:14:38 Public ads include 1 submitter, 30 startd >03/25/14 14:14:38 Phase 2: Performing accounting ... >03/25/14 14:14:38 Entering compute_significant_attrs() >03/25/14 14:14:38 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:14:38 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:14:38 CustomerName=Customer.<none> , Old Priority=0.828 , New Priority=0.833 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:38 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=42435.000 (unweighted 42435.000), BeginUsageTime=1395751882 >03/25/14 14:14:38 CustomerName=Customer.test@<hostname> , Old Priority=0.828 , New Priority=0.833 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:38 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=42435.000 (unweighted 42435.000), BeginUsageTime=1395751882 >03/25/14 14:14:38 (Accountant) Checking Matches >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:14:38 Match already existed! >03/25/14 14:14:38 Previous Limits -- >03/25/14 14:14:38 Limit: test = 3.000000 >03/25/14 14:14:38 Limit: small.test = 2.000000 >03/25/14 14:14:38 Limit: medium.test = 5.000000 >03/25/14 14:14:38 Limit: undef.test = 1.000000 >03/25/14 14:14:38 Limit: undef = 1.000000 >03/25/14 14:14:38 Limit: large.test = 13.000000 >03/25/14 14:14:38 Limit: medium.undef = 5.000000 >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(medium.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(medium.undef) >03/25/14 14:14:38 IncrementLimit(small.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(medium.undef) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(medium.undef) >03/25/14 14:14:38 IncrementLimit(medium.undef) >03/25/14 14:14:38 IncrementLimit(medium.undef) >03/25/14 14:14:38 IncrementLimit(small.test) >03/25/14 14:14:38 IncrementLimit(test) >03/25/14 14:14:38 IncrementLimit(medium.test) >03/25/14 14:14:38 IncrementLimit(test) >03/25/14 14:14:38 IncrementLimit(medium.test) >03/25/14 14:14:38 IncrementLimit(test) >03/25/14 14:14:38 IncrementLimit(medium.test) >03/25/14 14:14:38 IncrementLimit(undef.test) >03/25/14 14:14:38 IncrementLimit(medium.test) >03/25/14 14:14:38 IncrementLimit(undef) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 IncrementLimit(large.test) >03/25/14 14:14:38 Current Limits -- >03/25/14 14:14:38 Limit: test = 3.000000 >03/25/14 14:14:38 Limit: small.test = 2.000000 >03/25/14 14:14:38 Limit: medium.test = 5.000000 >03/25/14 14:14:38 Limit: undef.test = 1.000000 >03/25/14 14:14:38 Limit: undef = 1.000000 >03/25/14 14:14:38 Limit: large.test = 13.000000 >03/25/14 14:14:38 Limit: medium.undef = 5.000000 >03/25/14 14:14:38 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:14:38 Phase 4.1: Negotiating with schedds ... >03/25/14 14:14:38 numSlots = 30 >03/25/14 14:14:38 slotWeightTotal = 30.000000 >03/25/14 14:14:38 pieLeft = 0.000 >03/25/14 14:14:38 NormalFactor = 1.000000 >03/25/14 14:14:38 MaxPrioValue = 0.832877 >03/25/14 14:14:38 NumSubmitterAds = 1 >03/25/14 14:14:38 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:14:38 0 seconds so far >03/25/14 14:14:38 Calculating submitter limit with the following parameters >03/25/14 14:14:38 SubmitterPrio = 0.832877 >03/25/14 14:14:38 SubmitterPrioFactor = 1.000000 >03/25/14 14:14:38 submitterShare = 1.000000 >03/25/14 14:14:38 submitterAbsShare = 1.000000 >03/25/14 14:14:38 submitterLimit = 0.000000 >03/25/14 14:14:38 submitterUsage = 30.000000 >03/25/14 14:14:38 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:14:38 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00011: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: large.test is 13.000000 >03/25/14 14:14:38 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:14:38 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00025: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:14:38 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:38 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00042: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: small.test is 2.000000 >03/25/14 14:14:38 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:14:38 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00063: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: test is 3.000000 >03/25/14 14:14:38 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:14:38 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00081: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:14:38 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:38 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00101: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: undef is 1.000000 >03/25/14 14:14:38 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:38 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:38 Request 00001.00125: >03/25/14 14:14:38 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:38 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:14:38 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:38 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:14:38 Sending SEND_JOB_INFO/eom >03/25/14 14:14:38 Getting reply from schedd ... >03/25/14 14:14:38 Got NO_MORE_JOBS; done negotiating >03/25/14 14:14:38 This submitter hit its submitterLimit. >03/25/14 14:14:38 resources used scheddUsed= 30.000000 >03/25/14 14:14:38 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:14:38 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:14:38 Getting monitoring info for pid 22893 >03/25/14 14:14:39 Getting monitoring info for pid 22893 >03/25/14 14:14:40 Getting monitoring info for pid 22893 >03/25/14 14:14:41 Getting monitoring info for pid 22893 >03/25/14 14:14:42 Getting monitoring info for pid 22893 >03/25/14 14:14:43 Getting monitoring info for pid 22893 >03/25/14 14:14:44 Getting monitoring info for pid 22893 >03/25/14 14:14:45 Getting monitoring info for pid 22893 >03/25/14 14:14:46 Getting monitoring info for pid 22893 >03/25/14 14:14:47 Getting monitoring info for pid 22893 >03/25/14 14:14:48 Getting monitoring info for pid 22893 >03/25/14 14:14:49 Getting monitoring info for pid 22893 >03/25/14 14:14:50 Getting monitoring info for pid 22893 >03/25/14 14:14:51 Getting monitoring info for pid 22893 >03/25/14 14:14:52 Getting monitoring info for pid 22893 >03/25/14 14:14:53 Getting monitoring info for pid 22893 >03/25/14 14:14:54 Getting monitoring info for pid 22893 >03/25/14 14:14:55 Getting monitoring info for pid 22893 >03/25/14 14:14:56 Getting monitoring info for pid 22893 >03/25/14 14:14:57 Getting monitoring info for pid 22893 >03/25/14 14:14:58 ---------- Started Negotiation Cycle ---------- >03/25/14 14:14:58 Phase 1: Obtaining ads from collector ... >03/25/14 14:14:58 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:14:58 Trying to query collector <IP:9618> >03/25/14 14:14:58 Sorting 32 ads ... >03/25/14 14:14:58 Getting startd private ads ... >03/25/14 14:14:58 Trying to query collector <IP:9618> >03/25/14 14:14:58 Got ads: 32 public and 30 private >03/25/14 14:14:58 Public ads include 1 submitter, 30 startd >03/25/14 14:14:58 Phase 2: Performing accounting ... >03/25/14 14:14:58 Entering compute_significant_attrs() >03/25/14 14:14:58 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:14:58 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:14:58 CustomerName=Customer.<none> , Old Priority=0.833 , New Priority=0.838 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:58 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=43035.000 (unweighted 43035.000), BeginUsageTime=1395751882 >03/25/14 14:14:58 CustomerName=Customer.test@<hostname> , Old Priority=0.833 , New Priority=0.838 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:14:58 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=43035.000 (unweighted 43035.000), BeginUsageTime=1395751882 >03/25/14 14:14:59 (Accountant) Checking Matches >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:14:59 Match already existed! >03/25/14 14:14:59 Previous Limits -- >03/25/14 14:14:59 Limit: test = 3.000000 >03/25/14 14:14:59 Limit: small.test = 2.000000 >03/25/14 14:14:59 Limit: medium.test = 5.000000 >03/25/14 14:14:59 Limit: undef.test = 1.000000 >03/25/14 14:14:59 Limit: undef = 1.000000 >03/25/14 14:14:59 Limit: large.test = 13.000000 >03/25/14 14:14:59 Limit: medium.undef = 5.000000 >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(medium.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(medium.undef) >03/25/14 14:14:59 IncrementLimit(small.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(medium.undef) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(medium.undef) >03/25/14 14:14:59 IncrementLimit(medium.undef) >03/25/14 14:14:59 IncrementLimit(medium.undef) >03/25/14 14:14:59 IncrementLimit(small.test) >03/25/14 14:14:59 IncrementLimit(test) >03/25/14 14:14:59 IncrementLimit(medium.test) >03/25/14 14:14:59 IncrementLimit(test) >03/25/14 14:14:59 IncrementLimit(medium.test) >03/25/14 14:14:59 IncrementLimit(test) >03/25/14 14:14:59 IncrementLimit(medium.test) >03/25/14 14:14:59 IncrementLimit(undef.test) >03/25/14 14:14:59 IncrementLimit(medium.test) >03/25/14 14:14:59 IncrementLimit(undef) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 IncrementLimit(large.test) >03/25/14 14:14:59 Current Limits -- >03/25/14 14:14:59 Limit: test = 3.000000 >03/25/14 14:14:59 Limit: small.test = 2.000000 >03/25/14 14:14:59 Limit: medium.test = 5.000000 >03/25/14 14:14:59 Limit: undef.test = 1.000000 >03/25/14 14:14:59 Limit: undef = 1.000000 >03/25/14 14:14:59 Limit: large.test = 13.000000 >03/25/14 14:14:59 Limit: medium.undef = 5.000000 >03/25/14 14:14:59 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:14:59 Phase 4.1: Negotiating with schedds ... >03/25/14 14:14:59 numSlots = 30 >03/25/14 14:14:59 slotWeightTotal = 30.000000 >03/25/14 14:14:59 pieLeft = 0.000 >03/25/14 14:14:59 NormalFactor = 1.000000 >03/25/14 14:14:59 MaxPrioValue = 0.837557 >03/25/14 14:14:59 NumSubmitterAds = 1 >03/25/14 14:14:59 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:14:59 0 seconds so far >03/25/14 14:14:59 Calculating submitter limit with the following parameters >03/25/14 14:14:59 SubmitterPrio = 0.837557 >03/25/14 14:14:59 SubmitterPrioFactor = 1.000000 >03/25/14 14:14:59 submitterShare = 1.000000 >03/25/14 14:14:59 submitterAbsShare = 1.000000 >03/25/14 14:14:59 submitterLimit = 0.000000 >03/25/14 14:14:59 submitterUsage = 30.000000 >03/25/14 14:14:59 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:14:59 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00011: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: large.test is 13.000000 >03/25/14 14:14:59 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:14:59 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00025: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:14:59 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:59 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00042: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: small.test is 2.000000 >03/25/14 14:14:59 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:14:59 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00063: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: test is 3.000000 >03/25/14 14:14:59 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:14:59 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00081: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:14:59 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:59 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00101: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: undef is 1.000000 >03/25/14 14:14:59 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:14:59 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:14:59 Request 00001.00125: >03/25/14 14:14:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:14:59 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:14:59 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:14:59 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:14:59 Sending SEND_JOB_INFO/eom >03/25/14 14:14:59 Getting reply from schedd ... >03/25/14 14:14:59 Got NO_MORE_JOBS; done negotiating >03/25/14 14:14:59 This submitter hit its submitterLimit. >03/25/14 14:14:59 resources used scheddUsed= 30.000000 >03/25/14 14:14:59 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:14:59 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:14:59 Getting monitoring info for pid 22893 >03/25/14 14:15:00 Getting monitoring info for pid 22893 >03/25/14 14:15:01 Getting monitoring info for pid 22893 >03/25/14 14:15:02 Getting monitoring info for pid 22893 >03/25/14 14:15:03 Getting monitoring info for pid 22893 >03/25/14 14:15:04 Getting monitoring info for pid 22893 >03/25/14 14:15:05 Getting monitoring info for pid 22893 >03/25/14 14:15:06 Getting monitoring info for pid 22893 >03/25/14 14:15:07 Getting monitoring info for pid 22893 >03/25/14 14:15:08 Getting monitoring info for pid 22893 >03/25/14 14:15:09 Getting monitoring info for pid 22893 >03/25/14 14:15:10 Getting monitoring info for pid 22893 >03/25/14 14:15:11 Getting monitoring info for pid 22893 >03/25/14 14:15:12 Getting monitoring info for pid 22893 >03/25/14 14:15:13 Getting monitoring info for pid 22893 >03/25/14 14:15:14 Getting monitoring info for pid 22893 >03/25/14 14:15:15 Getting monitoring info for pid 22893 >03/25/14 14:15:16 Getting monitoring info for pid 22893 >03/25/14 14:15:17 Getting monitoring info for pid 22893 >03/25/14 14:15:18 Getting monitoring info for pid 22893 >03/25/14 14:15:19 ---------- Started Negotiation Cycle ---------- >03/25/14 14:15:19 Phase 1: Obtaining ads from collector ... >03/25/14 14:15:19 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:15:19 Trying to query collector <IP:9618> >03/25/14 14:15:19 Sorting 32 ads ... >03/25/14 14:15:19 Getting startd private ads ... >03/25/14 14:15:19 Trying to query collector <IP:9618> >03/25/14 14:15:19 Got ads: 32 public and 30 private >03/25/14 14:15:19 Public ads include 1 submitter, 30 startd >03/25/14 14:15:19 Phase 2: Performing accounting ... >03/25/14 14:15:19 Entering compute_significant_attrs() >03/25/14 14:15:19 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:15:19 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:15:19 CustomerName=Customer.<none> , Old Priority=0.838 , New Priority=0.842 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=43665.000 (unweighted 43665.000), BeginUsageTime=1395751882 >03/25/14 14:15:19 CustomerName=Customer.test@<hostname> , Old Priority=0.838 , New Priority=0.842 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=43665.000 (unweighted 43665.000), BeginUsageTime=1395751882 >03/25/14 14:15:19 (Accountant) Checking Matches >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:15:19 Match already existed! >03/25/14 14:15:19 Previous Limits -- >03/25/14 14:15:19 Limit: test = 3.000000 >03/25/14 14:15:19 Limit: small.test = 2.000000 >03/25/14 14:15:19 Limit: medium.test = 5.000000 >03/25/14 14:15:19 Limit: undef.test = 1.000000 >03/25/14 14:15:19 Limit: undef = 1.000000 >03/25/14 14:15:19 Limit: large.test = 13.000000 >03/25/14 14:15:19 Limit: medium.undef = 5.000000 >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(medium.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(medium.undef) >03/25/14 14:15:19 IncrementLimit(small.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(medium.undef) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(medium.undef) >03/25/14 14:15:19 IncrementLimit(medium.undef) >03/25/14 14:15:19 IncrementLimit(medium.undef) >03/25/14 14:15:19 IncrementLimit(small.test) >03/25/14 14:15:19 IncrementLimit(test) >03/25/14 14:15:19 IncrementLimit(medium.test) >03/25/14 14:15:19 IncrementLimit(test) >03/25/14 14:15:19 IncrementLimit(medium.test) >03/25/14 14:15:19 IncrementLimit(test) >03/25/14 14:15:19 IncrementLimit(medium.test) >03/25/14 14:15:19 IncrementLimit(undef.test) >03/25/14 14:15:19 IncrementLimit(medium.test) >03/25/14 14:15:19 IncrementLimit(undef) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 IncrementLimit(large.test) >03/25/14 14:15:19 Current Limits -- >03/25/14 14:15:19 Limit: test = 3.000000 >03/25/14 14:15:19 Limit: small.test = 2.000000 >03/25/14 14:15:19 Limit: medium.test = 5.000000 >03/25/14 14:15:19 Limit: undef.test = 1.000000 >03/25/14 14:15:19 Limit: undef = 1.000000 >03/25/14 14:15:19 Limit: large.test = 13.000000 >03/25/14 14:15:19 Limit: medium.undef = 5.000000 >03/25/14 14:15:19 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:15:19 Phase 4.1: Negotiating with schedds ... >03/25/14 14:15:19 numSlots = 30 >03/25/14 14:15:19 slotWeightTotal = 30.000000 >03/25/14 14:15:19 pieLeft = 0.000 >03/25/14 14:15:19 NormalFactor = 1.000000 >03/25/14 14:15:19 MaxPrioValue = 0.842469 >03/25/14 14:15:19 NumSubmitterAds = 1 >03/25/14 14:15:19 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:15:19 0 seconds so far >03/25/14 14:15:19 Calculating submitter limit with the following parameters >03/25/14 14:15:19 SubmitterPrio = 0.842469 >03/25/14 14:15:19 SubmitterPrioFactor = 1.000000 >03/25/14 14:15:19 submitterShare = 1.000000 >03/25/14 14:15:19 submitterAbsShare = 1.000000 >03/25/14 14:15:19 submitterLimit = 0.000000 >03/25/14 14:15:19 submitterUsage = 30.000000 >03/25/14 14:15:19 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:15:19 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00011: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: large.test is 13.000000 >03/25/14 14:15:19 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:15:19 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00025: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:15:19 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:19 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00042: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: small.test is 2.000000 >03/25/14 14:15:19 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:15:19 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00063: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: test is 3.000000 >03/25/14 14:15:19 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:15:19 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00081: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:15:19 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:19 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00101: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: undef is 1.000000 >03/25/14 14:15:19 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:19 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:19 Request 00001.00125: >03/25/14 14:15:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:19 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:15:19 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:19 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:15:19 Sending SEND_JOB_INFO/eom >03/25/14 14:15:19 Getting reply from schedd ... >03/25/14 14:15:19 Got NO_MORE_JOBS; done negotiating >03/25/14 14:15:19 This submitter hit its submitterLimit. >03/25/14 14:15:19 resources used scheddUsed= 30.000000 >03/25/14 14:15:19 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:15:19 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:15:19 Getting monitoring info for pid 22893 >03/25/14 14:15:20 Getting monitoring info for pid 22893 >03/25/14 14:15:21 Getting monitoring info for pid 22893 >03/25/14 14:15:22 Getting monitoring info for pid 22893 >03/25/14 14:15:23 Getting monitoring info for pid 22893 >03/25/14 14:15:24 Getting monitoring info for pid 22893 >03/25/14 14:15:25 Getting monitoring info for pid 22893 >03/25/14 14:15:26 Getting monitoring info for pid 22893 >03/25/14 14:15:27 Getting monitoring info for pid 22893 >03/25/14 14:15:28 Getting monitoring info for pid 22893 >03/25/14 14:15:29 Getting monitoring info for pid 22893 >03/25/14 14:15:30 enter Matchmaker::updateCollector >03/25/14 14:15:30 Warning: Could not find DaemonStartTime >03/25/14 14:15:30 Trying to update collector <IP:9618> >03/25/14 14:15:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:15:30 exit Matchmaker::UpdateCollector >03/25/14 14:15:30 Getting monitoring info for pid 22893 >03/25/14 14:15:31 Getting monitoring info for pid 22893 >03/25/14 14:15:32 Getting monitoring info for pid 22893 >03/25/14 14:15:33 Getting monitoring info for pid 22893 >03/25/14 14:15:34 Getting monitoring info for pid 22893 >03/25/14 14:15:35 Getting monitoring info for pid 22893 >03/25/14 14:15:36 Getting monitoring info for pid 22893 >03/25/14 14:15:37 Getting monitoring info for pid 22893 >03/25/14 14:15:38 Getting monitoring info for pid 22893 >03/25/14 14:15:39 ---------- Started Negotiation Cycle ---------- >03/25/14 14:15:39 Phase 1: Obtaining ads from collector ... >03/25/14 14:15:39 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:15:39 Trying to query collector <IP:9618> >03/25/14 14:15:39 Sorting 32 ads ... >03/25/14 14:15:39 Getting startd private ads ... >03/25/14 14:15:39 Trying to query collector <IP:9618> >03/25/14 14:15:39 Got ads: 32 public and 30 private >03/25/14 14:15:39 Public ads include 1 submitter, 30 startd >03/25/14 14:15:39 Phase 2: Performing accounting ... >03/25/14 14:15:39 Entering compute_significant_attrs() >03/25/14 14:15:39 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:15:39 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:15:39 CustomerName=Customer.<none> , Old Priority=0.842 , New Priority=0.847 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=44265.000 (unweighted 44265.000), BeginUsageTime=1395751882 >03/25/14 14:15:39 CustomerName=Customer.test@<hostname> , Old Priority=0.842 , New Priority=0.847 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=44265.000 (unweighted 44265.000), BeginUsageTime=1395751882 >03/25/14 14:15:39 (Accountant) Checking Matches >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:15:39 Match already existed! >03/25/14 14:15:39 Previous Limits -- >03/25/14 14:15:39 Limit: test = 3.000000 >03/25/14 14:15:39 Limit: small.test = 2.000000 >03/25/14 14:15:39 Limit: medium.test = 5.000000 >03/25/14 14:15:39 Limit: undef.test = 1.000000 >03/25/14 14:15:39 Limit: undef = 1.000000 >03/25/14 14:15:39 Limit: large.test = 13.000000 >03/25/14 14:15:39 Limit: medium.undef = 5.000000 >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(medium.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(medium.undef) >03/25/14 14:15:39 IncrementLimit(small.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(medium.undef) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(medium.undef) >03/25/14 14:15:39 IncrementLimit(medium.undef) >03/25/14 14:15:39 IncrementLimit(medium.undef) >03/25/14 14:15:39 IncrementLimit(small.test) >03/25/14 14:15:39 IncrementLimit(test) >03/25/14 14:15:39 IncrementLimit(medium.test) >03/25/14 14:15:39 IncrementLimit(test) >03/25/14 14:15:39 IncrementLimit(medium.test) >03/25/14 14:15:39 IncrementLimit(test) >03/25/14 14:15:39 IncrementLimit(medium.test) >03/25/14 14:15:39 IncrementLimit(undef.test) >03/25/14 14:15:39 IncrementLimit(medium.test) >03/25/14 14:15:39 IncrementLimit(undef) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 IncrementLimit(large.test) >03/25/14 14:15:39 Current Limits -- >03/25/14 14:15:39 Limit: test = 3.000000 >03/25/14 14:15:39 Limit: small.test = 2.000000 >03/25/14 14:15:39 Limit: medium.test = 5.000000 >03/25/14 14:15:39 Limit: undef.test = 1.000000 >03/25/14 14:15:39 Limit: undef = 1.000000 >03/25/14 14:15:39 Limit: large.test = 13.000000 >03/25/14 14:15:39 Limit: medium.undef = 5.000000 >03/25/14 14:15:39 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:15:39 Phase 4.1: Negotiating with schedds ... >03/25/14 14:15:39 numSlots = 30 >03/25/14 14:15:39 slotWeightTotal = 30.000000 >03/25/14 14:15:39 pieLeft = 0.000 >03/25/14 14:15:39 NormalFactor = 1.000000 >03/25/14 14:15:39 MaxPrioValue = 0.847147 >03/25/14 14:15:39 NumSubmitterAds = 1 >03/25/14 14:15:39 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:15:39 0 seconds so far >03/25/14 14:15:39 Calculating submitter limit with the following parameters >03/25/14 14:15:39 SubmitterPrio = 0.847147 >03/25/14 14:15:39 SubmitterPrioFactor = 1.000000 >03/25/14 14:15:39 submitterShare = 1.000000 >03/25/14 14:15:39 submitterAbsShare = 1.000000 >03/25/14 14:15:39 submitterLimit = 0.000000 >03/25/14 14:15:39 submitterUsage = 30.000000 >03/25/14 14:15:39 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:15:39 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00011: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: large.test is 13.000000 >03/25/14 14:15:39 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:15:39 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00025: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:15:39 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:39 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00042: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: small.test is 2.000000 >03/25/14 14:15:39 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:15:39 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00063: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: test is 3.000000 >03/25/14 14:15:39 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:15:39 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00081: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:15:39 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:39 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00101: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: undef is 1.000000 >03/25/14 14:15:39 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:39 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:39 Request 00001.00125: >03/25/14 14:15:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:39 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:15:39 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:39 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:15:39 Sending SEND_JOB_INFO/eom >03/25/14 14:15:39 Getting reply from schedd ... >03/25/14 14:15:39 Got NO_MORE_JOBS; done negotiating >03/25/14 14:15:39 This submitter hit its submitterLimit. >03/25/14 14:15:39 resources used scheddUsed= 30.000000 >03/25/14 14:15:39 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:15:39 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:15:39 Getting monitoring info for pid 22893 >03/25/14 14:15:40 Getting monitoring info for pid 22893 >03/25/14 14:15:41 Getting monitoring info for pid 22893 >03/25/14 14:15:42 Getting monitoring info for pid 22893 >03/25/14 14:15:43 Getting monitoring info for pid 22893 >03/25/14 14:15:44 Getting monitoring info for pid 22893 >03/25/14 14:15:45 Getting monitoring info for pid 22893 >03/25/14 14:15:46 Getting monitoring info for pid 22893 >03/25/14 14:15:47 Getting monitoring info for pid 22893 >03/25/14 14:15:48 Getting monitoring info for pid 22893 >03/25/14 14:15:49 Getting monitoring info for pid 22893 >03/25/14 14:15:50 Getting monitoring info for pid 22893 >03/25/14 14:15:51 Getting monitoring info for pid 22893 >03/25/14 14:15:52 Getting monitoring info for pid 22893 >03/25/14 14:15:53 Getting monitoring info for pid 22893 >03/25/14 14:15:54 Getting monitoring info for pid 22893 >03/25/14 14:15:55 Getting monitoring info for pid 22893 >03/25/14 14:15:56 Getting monitoring info for pid 22893 >03/25/14 14:15:57 Getting monitoring info for pid 22893 >03/25/14 14:15:58 Getting monitoring info for pid 22893 >03/25/14 14:15:59 ---------- Started Negotiation Cycle ---------- >03/25/14 14:15:59 Phase 1: Obtaining ads from collector ... >03/25/14 14:15:59 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:15:59 Trying to query collector <IP:9618> >03/25/14 14:15:59 Sorting 32 ads ... >03/25/14 14:15:59 Getting startd private ads ... >03/25/14 14:15:59 Trying to query collector <IP:9618> >03/25/14 14:15:59 Got ads: 32 public and 30 private >03/25/14 14:15:59 Public ads include 1 submitter, 30 startd >03/25/14 14:15:59 Phase 2: Performing accounting ... >03/25/14 14:15:59 Entering compute_significant_attrs() >03/25/14 14:15:59 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:15:59 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:15:59 CustomerName=Customer.<none> , Old Priority=0.847 , New Priority=0.852 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=44865.000 (unweighted 44865.000), BeginUsageTime=1395751882 >03/25/14 14:15:59 CustomerName=Customer.test@<hostname> , Old Priority=0.847 , New Priority=0.852 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:15:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=44865.000 (unweighted 44865.000), BeginUsageTime=1395751882 >03/25/14 14:15:59 (Accountant) Checking Matches >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:15:59 Match already existed! >03/25/14 14:15:59 Previous Limits -- >03/25/14 14:15:59 Limit: test = 3.000000 >03/25/14 14:15:59 Limit: small.test = 2.000000 >03/25/14 14:15:59 Limit: medium.test = 5.000000 >03/25/14 14:15:59 Limit: undef.test = 1.000000 >03/25/14 14:15:59 Limit: undef = 1.000000 >03/25/14 14:15:59 Limit: large.test = 13.000000 >03/25/14 14:15:59 Limit: medium.undef = 5.000000 >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(medium.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(medium.undef) >03/25/14 14:15:59 IncrementLimit(small.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(medium.undef) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(medium.undef) >03/25/14 14:15:59 IncrementLimit(medium.undef) >03/25/14 14:15:59 IncrementLimit(medium.undef) >03/25/14 14:15:59 IncrementLimit(small.test) >03/25/14 14:15:59 IncrementLimit(test) >03/25/14 14:15:59 IncrementLimit(medium.test) >03/25/14 14:15:59 IncrementLimit(test) >03/25/14 14:15:59 IncrementLimit(medium.test) >03/25/14 14:15:59 IncrementLimit(test) >03/25/14 14:15:59 IncrementLimit(medium.test) >03/25/14 14:15:59 IncrementLimit(undef.test) >03/25/14 14:15:59 IncrementLimit(medium.test) >03/25/14 14:15:59 IncrementLimit(undef) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 IncrementLimit(large.test) >03/25/14 14:15:59 Current Limits -- >03/25/14 14:15:59 Limit: test = 3.000000 >03/25/14 14:15:59 Limit: small.test = 2.000000 >03/25/14 14:15:59 Limit: medium.test = 5.000000 >03/25/14 14:15:59 Limit: undef.test = 1.000000 >03/25/14 14:15:59 Limit: undef = 1.000000 >03/25/14 14:15:59 Limit: large.test = 13.000000 >03/25/14 14:15:59 Limit: medium.undef = 5.000000 >03/25/14 14:15:59 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:15:59 Phase 4.1: Negotiating with schedds ... >03/25/14 14:15:59 numSlots = 30 >03/25/14 14:15:59 slotWeightTotal = 30.000000 >03/25/14 14:15:59 pieLeft = 0.000 >03/25/14 14:15:59 NormalFactor = 1.000000 >03/25/14 14:15:59 MaxPrioValue = 0.851825 >03/25/14 14:15:59 NumSubmitterAds = 1 >03/25/14 14:15:59 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:15:59 0 seconds so far >03/25/14 14:15:59 Calculating submitter limit with the following parameters >03/25/14 14:15:59 SubmitterPrio = 0.851825 >03/25/14 14:15:59 SubmitterPrioFactor = 1.000000 >03/25/14 14:15:59 submitterShare = 1.000000 >03/25/14 14:15:59 submitterAbsShare = 1.000000 >03/25/14 14:15:59 submitterLimit = 0.000000 >03/25/14 14:15:59 submitterUsage = 30.000000 >03/25/14 14:15:59 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:15:59 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00011: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: large.test is 13.000000 >03/25/14 14:15:59 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:15:59 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00025: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:15:59 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:59 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00042: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: small.test is 2.000000 >03/25/14 14:15:59 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:15:59 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00063: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: test is 3.000000 >03/25/14 14:15:59 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:15:59 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00081: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:15:59 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:59 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00101: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: undef is 1.000000 >03/25/14 14:15:59 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:15:59 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:15:59 Request 00001.00125: >03/25/14 14:15:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:15:59 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:15:59 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:15:59 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:15:59 Sending SEND_JOB_INFO/eom >03/25/14 14:15:59 Getting reply from schedd ... >03/25/14 14:15:59 Got NO_MORE_JOBS; done negotiating >03/25/14 14:15:59 This submitter hit its submitterLimit. >03/25/14 14:15:59 resources used scheddUsed= 30.000000 >03/25/14 14:15:59 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:15:59 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:15:59 Getting monitoring info for pid 22893 >03/25/14 14:16:00 Getting monitoring info for pid 22893 >03/25/14 14:16:01 Getting monitoring info for pid 22893 >03/25/14 14:16:02 Getting monitoring info for pid 22893 >03/25/14 14:16:03 Getting monitoring info for pid 22893 >03/25/14 14:16:04 Getting monitoring info for pid 22893 >03/25/14 14:16:05 Getting monitoring info for pid 22893 >03/25/14 14:16:06 Getting monitoring info for pid 22893 >03/25/14 14:16:07 Getting monitoring info for pid 22893 >03/25/14 14:16:08 Getting monitoring info for pid 22893 >03/25/14 14:16:09 Getting monitoring info for pid 22893 >03/25/14 14:16:10 Getting monitoring info for pid 22893 >03/25/14 14:16:11 Getting monitoring info for pid 22893 >03/25/14 14:16:12 Getting monitoring info for pid 22893 >03/25/14 14:16:13 Getting monitoring info for pid 22893 >03/25/14 14:16:14 Getting monitoring info for pid 22893 >03/25/14 14:16:15 Getting monitoring info for pid 22893 >03/25/14 14:16:16 Getting monitoring info for pid 22893 >03/25/14 14:16:17 Getting monitoring info for pid 22893 >03/25/14 14:16:18 Getting monitoring info for pid 22893 >03/25/14 14:16:19 ---------- Started Negotiation Cycle ---------- >03/25/14 14:16:19 Phase 1: Obtaining ads from collector ... >03/25/14 14:16:19 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:16:19 Trying to query collector <IP:9618> >03/25/14 14:16:19 Sorting 32 ads ... >03/25/14 14:16:19 Getting startd private ads ... >03/25/14 14:16:19 Trying to query collector <IP:9618> >03/25/14 14:16:19 Got ads: 32 public and 30 private >03/25/14 14:16:19 Public ads include 1 submitter, 30 startd >03/25/14 14:16:19 Phase 2: Performing accounting ... >03/25/14 14:16:19 Entering compute_significant_attrs() >03/25/14 14:16:19 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:16:19 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:16:19 CustomerName=Customer.<none> , Old Priority=0.852 , New Priority=0.857 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=45465.000 (unweighted 45465.000), BeginUsageTime=1395751882 >03/25/14 14:16:19 CustomerName=Customer.test@<hostname> , Old Priority=0.852 , New Priority=0.857 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=45465.000 (unweighted 45465.000), BeginUsageTime=1395751882 >03/25/14 14:16:19 (Accountant) Checking Matches >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:16:19 Match already existed! >03/25/14 14:16:19 Previous Limits -- >03/25/14 14:16:19 Limit: test = 3.000000 >03/25/14 14:16:19 Limit: small.test = 2.000000 >03/25/14 14:16:19 Limit: medium.test = 5.000000 >03/25/14 14:16:19 Limit: undef.test = 1.000000 >03/25/14 14:16:19 Limit: undef = 1.000000 >03/25/14 14:16:19 Limit: large.test = 13.000000 >03/25/14 14:16:19 Limit: medium.undef = 5.000000 >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(medium.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(medium.undef) >03/25/14 14:16:19 IncrementLimit(small.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(medium.undef) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(medium.undef) >03/25/14 14:16:19 IncrementLimit(medium.undef) >03/25/14 14:16:19 IncrementLimit(medium.undef) >03/25/14 14:16:19 IncrementLimit(small.test) >03/25/14 14:16:19 IncrementLimit(test) >03/25/14 14:16:19 IncrementLimit(medium.test) >03/25/14 14:16:19 IncrementLimit(test) >03/25/14 14:16:19 IncrementLimit(medium.test) >03/25/14 14:16:19 IncrementLimit(test) >03/25/14 14:16:19 IncrementLimit(medium.test) >03/25/14 14:16:19 IncrementLimit(undef.test) >03/25/14 14:16:19 IncrementLimit(medium.test) >03/25/14 14:16:19 IncrementLimit(undef) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 IncrementLimit(large.test) >03/25/14 14:16:19 Current Limits -- >03/25/14 14:16:19 Limit: test = 3.000000 >03/25/14 14:16:19 Limit: small.test = 2.000000 >03/25/14 14:16:19 Limit: medium.test = 5.000000 >03/25/14 14:16:19 Limit: undef.test = 1.000000 >03/25/14 14:16:19 Limit: undef = 1.000000 >03/25/14 14:16:19 Limit: large.test = 13.000000 >03/25/14 14:16:19 Limit: medium.undef = 5.000000 >03/25/14 14:16:19 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:16:19 Phase 4.1: Negotiating with schedds ... >03/25/14 14:16:19 numSlots = 30 >03/25/14 14:16:19 slotWeightTotal = 30.000000 >03/25/14 14:16:19 pieLeft = 0.000 >03/25/14 14:16:19 NormalFactor = 1.000000 >03/25/14 14:16:19 MaxPrioValue = 0.856502 >03/25/14 14:16:19 NumSubmitterAds = 1 >03/25/14 14:16:19 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:16:19 0 seconds so far >03/25/14 14:16:19 Calculating submitter limit with the following parameters >03/25/14 14:16:19 SubmitterPrio = 0.856502 >03/25/14 14:16:19 SubmitterPrioFactor = 1.000000 >03/25/14 14:16:19 submitterShare = 1.000000 >03/25/14 14:16:19 submitterAbsShare = 1.000000 >03/25/14 14:16:19 submitterLimit = 0.000000 >03/25/14 14:16:19 submitterUsage = 30.000000 >03/25/14 14:16:19 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:16:19 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00011: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: large.test is 13.000000 >03/25/14 14:16:19 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:16:19 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00025: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:16:19 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:19 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00042: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: small.test is 2.000000 >03/25/14 14:16:19 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:16:19 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00063: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: test is 3.000000 >03/25/14 14:16:19 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:16:19 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00081: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:16:19 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:19 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00101: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: undef is 1.000000 >03/25/14 14:16:19 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:19 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:19 Request 00001.00125: >03/25/14 14:16:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:19 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:16:19 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:19 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:16:19 Sending SEND_JOB_INFO/eom >03/25/14 14:16:19 Getting reply from schedd ... >03/25/14 14:16:19 Got NO_MORE_JOBS; done negotiating >03/25/14 14:16:19 This submitter hit its submitterLimit. >03/25/14 14:16:19 resources used scheddUsed= 30.000000 >03/25/14 14:16:19 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:16:19 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:16:19 Getting monitoring info for pid 22893 >03/25/14 14:16:20 Getting monitoring info for pid 22893 >03/25/14 14:16:21 Getting monitoring info for pid 22893 >03/25/14 14:16:22 Getting monitoring info for pid 22893 >03/25/14 14:16:23 Getting monitoring info for pid 22893 >03/25/14 14:16:24 Getting monitoring info for pid 22893 >03/25/14 14:16:25 Getting monitoring info for pid 22893 >03/25/14 14:16:26 Getting monitoring info for pid 22893 >03/25/14 14:16:27 Getting monitoring info for pid 22893 >03/25/14 14:16:28 Getting monitoring info for pid 22893 >03/25/14 14:16:29 Getting monitoring info for pid 22893 >03/25/14 14:16:30 Getting monitoring info for pid 22893 >03/25/14 14:16:31 Getting monitoring info for pid 22893 >03/25/14 14:16:32 Getting monitoring info for pid 22893 >03/25/14 14:16:33 Getting monitoring info for pid 22893 >03/25/14 14:16:34 Getting monitoring info for pid 22893 >03/25/14 14:16:35 Getting monitoring info for pid 22893 >03/25/14 14:16:36 Getting monitoring info for pid 22893 >03/25/14 14:16:37 Getting monitoring info for pid 22893 >03/25/14 14:16:38 Getting monitoring info for pid 22893 >03/25/14 14:16:39 ---------- Started Negotiation Cycle ---------- >03/25/14 14:16:39 Phase 1: Obtaining ads from collector ... >03/25/14 14:16:39 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:16:39 Trying to query collector <IP:9618> >03/25/14 14:16:39 Sorting 32 ads ... >03/25/14 14:16:39 Getting startd private ads ... >03/25/14 14:16:39 Trying to query collector <IP:9618> >03/25/14 14:16:39 Got ads: 32 public and 30 private >03/25/14 14:16:39 Public ads include 1 submitter, 30 startd >03/25/14 14:16:39 Phase 2: Performing accounting ... >03/25/14 14:16:39 Entering compute_significant_attrs() >03/25/14 14:16:39 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:16:39 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:16:39 CustomerName=Customer.<none> , Old Priority=0.857 , New Priority=0.861 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=46065.000 (unweighted 46065.000), BeginUsageTime=1395751882 >03/25/14 14:16:39 CustomerName=Customer.test@<hostname> , Old Priority=0.857 , New Priority=0.861 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=46065.000 (unweighted 46065.000), BeginUsageTime=1395751882 >03/25/14 14:16:39 (Accountant) Checking Matches >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:16:39 Match already existed! >03/25/14 14:16:39 Previous Limits -- >03/25/14 14:16:39 Limit: test = 3.000000 >03/25/14 14:16:39 Limit: small.test = 2.000000 >03/25/14 14:16:39 Limit: medium.test = 5.000000 >03/25/14 14:16:39 Limit: undef.test = 1.000000 >03/25/14 14:16:39 Limit: undef = 1.000000 >03/25/14 14:16:39 Limit: large.test = 13.000000 >03/25/14 14:16:39 Limit: medium.undef = 5.000000 >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(medium.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(medium.undef) >03/25/14 14:16:39 IncrementLimit(small.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(medium.undef) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(medium.undef) >03/25/14 14:16:39 IncrementLimit(medium.undef) >03/25/14 14:16:39 IncrementLimit(medium.undef) >03/25/14 14:16:39 IncrementLimit(small.test) >03/25/14 14:16:39 IncrementLimit(test) >03/25/14 14:16:39 IncrementLimit(medium.test) >03/25/14 14:16:39 IncrementLimit(test) >03/25/14 14:16:39 IncrementLimit(medium.test) >03/25/14 14:16:39 IncrementLimit(test) >03/25/14 14:16:39 IncrementLimit(medium.test) >03/25/14 14:16:39 IncrementLimit(undef.test) >03/25/14 14:16:39 IncrementLimit(medium.test) >03/25/14 14:16:39 IncrementLimit(undef) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 IncrementLimit(large.test) >03/25/14 14:16:39 Current Limits -- >03/25/14 14:16:39 Limit: test = 3.000000 >03/25/14 14:16:39 Limit: small.test = 2.000000 >03/25/14 14:16:39 Limit: medium.test = 5.000000 >03/25/14 14:16:39 Limit: undef.test = 1.000000 >03/25/14 14:16:39 Limit: undef = 1.000000 >03/25/14 14:16:39 Limit: large.test = 13.000000 >03/25/14 14:16:39 Limit: medium.undef = 5.000000 >03/25/14 14:16:39 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:16:39 Phase 4.1: Negotiating with schedds ... >03/25/14 14:16:39 numSlots = 30 >03/25/14 14:16:39 slotWeightTotal = 30.000000 >03/25/14 14:16:39 pieLeft = 0.000 >03/25/14 14:16:39 NormalFactor = 1.000000 >03/25/14 14:16:39 MaxPrioValue = 0.861178 >03/25/14 14:16:39 NumSubmitterAds = 1 >03/25/14 14:16:39 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:16:39 0 seconds so far >03/25/14 14:16:39 Calculating submitter limit with the following parameters >03/25/14 14:16:39 SubmitterPrio = 0.861178 >03/25/14 14:16:39 SubmitterPrioFactor = 1.000000 >03/25/14 14:16:39 submitterShare = 1.000000 >03/25/14 14:16:39 submitterAbsShare = 1.000000 >03/25/14 14:16:39 submitterLimit = 0.000000 >03/25/14 14:16:39 submitterUsage = 30.000000 >03/25/14 14:16:39 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:16:39 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00011: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: large.test is 13.000000 >03/25/14 14:16:39 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:16:39 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00025: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:16:39 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:39 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00042: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: small.test is 2.000000 >03/25/14 14:16:39 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:16:39 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00063: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: test is 3.000000 >03/25/14 14:16:39 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:16:39 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00081: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:16:39 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:39 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00101: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: undef is 1.000000 >03/25/14 14:16:39 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:39 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:39 Request 00001.00125: >03/25/14 14:16:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:39 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:16:39 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:39 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:16:39 Sending SEND_JOB_INFO/eom >03/25/14 14:16:39 Getting reply from schedd ... >03/25/14 14:16:39 Got NO_MORE_JOBS; done negotiating >03/25/14 14:16:39 This submitter hit its submitterLimit. >03/25/14 14:16:39 resources used scheddUsed= 30.000000 >03/25/14 14:16:39 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:16:39 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:16:39 Getting monitoring info for pid 22893 >03/25/14 14:16:40 Getting monitoring info for pid 22893 >03/25/14 14:16:41 Getting monitoring info for pid 22893 >03/25/14 14:16:42 Getting monitoring info for pid 22893 >03/25/14 14:16:43 Getting monitoring info for pid 22893 >03/25/14 14:16:44 Getting monitoring info for pid 22893 >03/25/14 14:16:46 Getting monitoring info for pid 22893 >03/25/14 14:16:47 Getting monitoring info for pid 22893 >03/25/14 14:16:48 Getting monitoring info for pid 22893 >03/25/14 14:16:49 Getting monitoring info for pid 22893 >03/25/14 14:16:50 Getting monitoring info for pid 22893 >03/25/14 14:16:51 Getting monitoring info for pid 22893 >03/25/14 14:16:52 Getting monitoring info for pid 22893 >03/25/14 14:16:53 Getting monitoring info for pid 22893 >03/25/14 14:16:54 Getting monitoring info for pid 22893 >03/25/14 14:16:55 Getting monitoring info for pid 22893 >03/25/14 14:16:56 Getting monitoring info for pid 22893 >03/25/14 14:16:57 Getting monitoring info for pid 22893 >03/25/14 14:16:58 Getting monitoring info for pid 22893 >03/25/14 14:16:59 ---------- Started Negotiation Cycle ---------- >03/25/14 14:16:59 Phase 1: Obtaining ads from collector ... >03/25/14 14:16:59 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:16:59 Trying to query collector <IP:9618> >03/25/14 14:16:59 Sorting 32 ads ... >03/25/14 14:16:59 Getting startd private ads ... >03/25/14 14:16:59 Trying to query collector <IP:9618> >03/25/14 14:16:59 Got ads: 32 public and 30 private >03/25/14 14:16:59 Public ads include 1 submitter, 30 startd >03/25/14 14:16:59 Phase 2: Performing accounting ... >03/25/14 14:16:59 Entering compute_significant_attrs() >03/25/14 14:16:59 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:16:59 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:16:59 CustomerName=Customer.<none> , Old Priority=0.861 , New Priority=0.866 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=46665.000 (unweighted 46665.000), BeginUsageTime=1395751882 >03/25/14 14:16:59 CustomerName=Customer.test@<hostname> , Old Priority=0.861 , New Priority=0.866 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:16:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=46665.000 (unweighted 46665.000), BeginUsageTime=1395751882 >03/25/14 14:16:59 (Accountant) Checking Matches >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:16:59 Match already existed! >03/25/14 14:16:59 Previous Limits -- >03/25/14 14:16:59 Limit: test = 3.000000 >03/25/14 14:16:59 Limit: small.test = 2.000000 >03/25/14 14:16:59 Limit: medium.test = 5.000000 >03/25/14 14:16:59 Limit: undef.test = 1.000000 >03/25/14 14:16:59 Limit: undef = 1.000000 >03/25/14 14:16:59 Limit: large.test = 13.000000 >03/25/14 14:16:59 Limit: medium.undef = 5.000000 >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(medium.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(medium.undef) >03/25/14 14:16:59 IncrementLimit(small.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(medium.undef) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(medium.undef) >03/25/14 14:16:59 IncrementLimit(medium.undef) >03/25/14 14:16:59 IncrementLimit(medium.undef) >03/25/14 14:16:59 IncrementLimit(small.test) >03/25/14 14:16:59 IncrementLimit(test) >03/25/14 14:16:59 IncrementLimit(medium.test) >03/25/14 14:16:59 IncrementLimit(test) >03/25/14 14:16:59 IncrementLimit(medium.test) >03/25/14 14:16:59 IncrementLimit(test) >03/25/14 14:16:59 IncrementLimit(medium.test) >03/25/14 14:16:59 IncrementLimit(undef.test) >03/25/14 14:16:59 IncrementLimit(medium.test) >03/25/14 14:16:59 IncrementLimit(undef) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 IncrementLimit(large.test) >03/25/14 14:16:59 Current Limits -- >03/25/14 14:16:59 Limit: test = 3.000000 >03/25/14 14:16:59 Limit: small.test = 2.000000 >03/25/14 14:16:59 Limit: medium.test = 5.000000 >03/25/14 14:16:59 Limit: undef.test = 1.000000 >03/25/14 14:16:59 Limit: undef = 1.000000 >03/25/14 14:16:59 Limit: large.test = 13.000000 >03/25/14 14:16:59 Limit: medium.undef = 5.000000 >03/25/14 14:16:59 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:16:59 Phase 4.1: Negotiating with schedds ... >03/25/14 14:16:59 numSlots = 30 >03/25/14 14:16:59 slotWeightTotal = 30.000000 >03/25/14 14:16:59 pieLeft = 0.000 >03/25/14 14:16:59 NormalFactor = 1.000000 >03/25/14 14:16:59 MaxPrioValue = 0.865853 >03/25/14 14:16:59 NumSubmitterAds = 1 >03/25/14 14:16:59 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:16:59 0 seconds so far >03/25/14 14:16:59 Calculating submitter limit with the following parameters >03/25/14 14:16:59 SubmitterPrio = 0.865853 >03/25/14 14:16:59 SubmitterPrioFactor = 1.000000 >03/25/14 14:16:59 submitterShare = 1.000000 >03/25/14 14:16:59 submitterAbsShare = 1.000000 >03/25/14 14:16:59 submitterLimit = 0.000000 >03/25/14 14:16:59 submitterUsage = 30.000000 >03/25/14 14:16:59 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:16:59 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00011: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: large.test is 13.000000 >03/25/14 14:16:59 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:16:59 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00025: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:16:59 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:59 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00042: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: small.test is 2.000000 >03/25/14 14:16:59 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:16:59 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00063: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: test is 3.000000 >03/25/14 14:16:59 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:16:59 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00081: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:16:59 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:59 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00101: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: undef is 1.000000 >03/25/14 14:16:59 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:16:59 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:16:59 Request 00001.00125: >03/25/14 14:16:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:16:59 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:16:59 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:16:59 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:16:59 Sending SEND_JOB_INFO/eom >03/25/14 14:16:59 Getting reply from schedd ... >03/25/14 14:16:59 Got NO_MORE_JOBS; done negotiating >03/25/14 14:16:59 This submitter hit its submitterLimit. >03/25/14 14:16:59 resources used scheddUsed= 30.000000 >03/25/14 14:16:59 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:16:59 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:16:59 Getting monitoring info for pid 22893 >03/25/14 14:17:00 Getting monitoring info for pid 22893 >03/25/14 14:17:01 Getting monitoring info for pid 22893 >03/25/14 14:17:02 Getting monitoring info for pid 22893 >03/25/14 14:17:03 Getting monitoring info for pid 22893 >03/25/14 14:17:04 Getting monitoring info for pid 22893 >03/25/14 14:17:05 Getting monitoring info for pid 22893 >03/25/14 14:17:06 Getting monitoring info for pid 22893 >03/25/14 14:17:07 Getting monitoring info for pid 22893 >03/25/14 14:17:08 Getting monitoring info for pid 22893 >03/25/14 14:17:09 Getting monitoring info for pid 22893 >03/25/14 14:17:10 Getting monitoring info for pid 22893 >03/25/14 14:17:11 Getting monitoring info for pid 22893 >03/25/14 14:17:12 Getting monitoring info for pid 22893 >03/25/14 14:17:13 Getting monitoring info for pid 22893 >03/25/14 14:17:14 Getting monitoring info for pid 22893 >03/25/14 14:17:15 Getting monitoring info for pid 22893 >03/25/14 14:17:16 Getting monitoring info for pid 22893 >03/25/14 14:17:17 Getting monitoring info for pid 22893 >03/25/14 14:17:18 Getting monitoring info for pid 22893 >03/25/14 14:17:19 ---------- Started Negotiation Cycle ---------- >03/25/14 14:17:19 Phase 1: Obtaining ads from collector ... >03/25/14 14:17:19 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:17:19 Trying to query collector <IP:9618> >03/25/14 14:17:19 Sorting 32 ads ... >03/25/14 14:17:19 Getting startd private ads ... >03/25/14 14:17:19 Trying to query collector <IP:9618> >03/25/14 14:17:19 Got ads: 32 public and 30 private >03/25/14 14:17:19 Public ads include 1 submitter, 30 startd >03/25/14 14:17:19 Phase 2: Performing accounting ... >03/25/14 14:17:19 Entering compute_significant_attrs() >03/25/14 14:17:19 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:17:19 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:17:19 CustomerName=Customer.<none> , Old Priority=0.866 , New Priority=0.871 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=47265.000 (unweighted 47265.000), BeginUsageTime=1395751882 >03/25/14 14:17:19 CustomerName=Customer.test@<hostname> , Old Priority=0.866 , New Priority=0.871 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=47265.000 (unweighted 47265.000), BeginUsageTime=1395751882 >03/25/14 14:17:19 (Accountant) Checking Matches >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:17:19 Match already existed! >03/25/14 14:17:19 Previous Limits -- >03/25/14 14:17:19 Limit: test = 3.000000 >03/25/14 14:17:19 Limit: small.test = 2.000000 >03/25/14 14:17:19 Limit: medium.test = 5.000000 >03/25/14 14:17:19 Limit: undef.test = 1.000000 >03/25/14 14:17:19 Limit: undef = 1.000000 >03/25/14 14:17:19 Limit: large.test = 13.000000 >03/25/14 14:17:19 Limit: medium.undef = 5.000000 >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(medium.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(medium.undef) >03/25/14 14:17:19 IncrementLimit(small.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(medium.undef) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(medium.undef) >03/25/14 14:17:19 IncrementLimit(medium.undef) >03/25/14 14:17:19 IncrementLimit(medium.undef) >03/25/14 14:17:19 IncrementLimit(small.test) >03/25/14 14:17:19 IncrementLimit(test) >03/25/14 14:17:19 IncrementLimit(medium.test) >03/25/14 14:17:19 IncrementLimit(test) >03/25/14 14:17:19 IncrementLimit(medium.test) >03/25/14 14:17:19 IncrementLimit(test) >03/25/14 14:17:19 IncrementLimit(medium.test) >03/25/14 14:17:19 IncrementLimit(undef.test) >03/25/14 14:17:19 IncrementLimit(medium.test) >03/25/14 14:17:19 IncrementLimit(undef) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 IncrementLimit(large.test) >03/25/14 14:17:19 Current Limits -- >03/25/14 14:17:19 Limit: test = 3.000000 >03/25/14 14:17:19 Limit: small.test = 2.000000 >03/25/14 14:17:19 Limit: medium.test = 5.000000 >03/25/14 14:17:19 Limit: undef.test = 1.000000 >03/25/14 14:17:19 Limit: undef = 1.000000 >03/25/14 14:17:19 Limit: large.test = 13.000000 >03/25/14 14:17:19 Limit: medium.undef = 5.000000 >03/25/14 14:17:19 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:17:19 Phase 4.1: Negotiating with schedds ... >03/25/14 14:17:19 numSlots = 30 >03/25/14 14:17:19 slotWeightTotal = 30.000000 >03/25/14 14:17:19 pieLeft = 0.000 >03/25/14 14:17:19 NormalFactor = 1.000000 >03/25/14 14:17:19 MaxPrioValue = 0.870528 >03/25/14 14:17:19 NumSubmitterAds = 1 >03/25/14 14:17:19 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:17:19 0 seconds so far >03/25/14 14:17:19 Calculating submitter limit with the following parameters >03/25/14 14:17:19 SubmitterPrio = 0.870528 >03/25/14 14:17:19 SubmitterPrioFactor = 1.000000 >03/25/14 14:17:19 submitterShare = 1.000000 >03/25/14 14:17:19 submitterAbsShare = 1.000000 >03/25/14 14:17:19 submitterLimit = 0.000000 >03/25/14 14:17:19 submitterUsage = 30.000000 >03/25/14 14:17:19 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:17:19 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00011: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: large.test is 13.000000 >03/25/14 14:17:19 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:17:19 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00025: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:17:19 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:19 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00042: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: small.test is 2.000000 >03/25/14 14:17:19 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:17:19 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00063: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: test is 3.000000 >03/25/14 14:17:19 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:17:19 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00081: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:17:19 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:19 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00101: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: undef is 1.000000 >03/25/14 14:17:19 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:19 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:19 Request 00001.00125: >03/25/14 14:17:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:19 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:17:19 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:19 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:17:19 Sending SEND_JOB_INFO/eom >03/25/14 14:17:19 Getting reply from schedd ... >03/25/14 14:17:19 Got NO_MORE_JOBS; done negotiating >03/25/14 14:17:19 This submitter hit its submitterLimit. >03/25/14 14:17:19 resources used scheddUsed= 30.000000 >03/25/14 14:17:19 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:17:19 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:17:19 Getting monitoring info for pid 22893 >03/25/14 14:17:20 Getting monitoring info for pid 22893 >03/25/14 14:17:21 Getting monitoring info for pid 22893 >03/25/14 14:17:22 Getting monitoring info for pid 22893 >03/25/14 14:17:23 Getting monitoring info for pid 22893 >03/25/14 14:17:24 Getting monitoring info for pid 22893 >03/25/14 14:17:25 Getting monitoring info for pid 22893 >03/25/14 14:17:26 Getting monitoring info for pid 22893 >03/25/14 14:17:27 Getting monitoring info for pid 22893 >03/25/14 14:17:28 Getting monitoring info for pid 22893 >03/25/14 14:17:29 Getting monitoring info for pid 22893 >03/25/14 14:17:30 Getting monitoring info for pid 22893 >03/25/14 14:17:31 Getting monitoring info for pid 22893 >03/25/14 14:17:32 Getting monitoring info for pid 22893 >03/25/14 14:17:33 Getting monitoring info for pid 22893 >03/25/14 14:17:34 Getting monitoring info for pid 22893 >03/25/14 14:17:35 Getting monitoring info for pid 22893 >03/25/14 14:17:36 Getting monitoring info for pid 22893 >03/25/14 14:17:37 Getting monitoring info for pid 22893 >03/25/14 14:17:38 Getting monitoring info for pid 22893 >03/25/14 14:17:39 ---------- Started Negotiation Cycle ---------- >03/25/14 14:17:39 Phase 1: Obtaining ads from collector ... >03/25/14 14:17:39 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:17:39 Trying to query collector <IP:9618> >03/25/14 14:17:39 Sorting 32 ads ... >03/25/14 14:17:39 Getting startd private ads ... >03/25/14 14:17:39 Trying to query collector <IP:9618> >03/25/14 14:17:39 Got ads: 32 public and 30 private >03/25/14 14:17:39 Public ads include 1 submitter, 30 startd >03/25/14 14:17:39 Phase 2: Performing accounting ... >03/25/14 14:17:39 Entering compute_significant_attrs() >03/25/14 14:17:39 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:17:39 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:17:39 CustomerName=Customer.<none> , Old Priority=0.871 , New Priority=0.875 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=47865.000 (unweighted 47865.000), BeginUsageTime=1395751882 >03/25/14 14:17:39 CustomerName=Customer.test@<hostname> , Old Priority=0.871 , New Priority=0.875 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:39 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=47865.000 (unweighted 47865.000), BeginUsageTime=1395751882 >03/25/14 14:17:39 (Accountant) Checking Matches >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:17:39 Match already existed! >03/25/14 14:17:39 Previous Limits -- >03/25/14 14:17:39 Limit: test = 3.000000 >03/25/14 14:17:39 Limit: small.test = 2.000000 >03/25/14 14:17:39 Limit: medium.test = 5.000000 >03/25/14 14:17:39 Limit: undef.test = 1.000000 >03/25/14 14:17:39 Limit: undef = 1.000000 >03/25/14 14:17:39 Limit: large.test = 13.000000 >03/25/14 14:17:39 Limit: medium.undef = 5.000000 >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(medium.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(medium.undef) >03/25/14 14:17:39 IncrementLimit(small.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(medium.undef) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(medium.undef) >03/25/14 14:17:39 IncrementLimit(medium.undef) >03/25/14 14:17:39 IncrementLimit(medium.undef) >03/25/14 14:17:39 IncrementLimit(small.test) >03/25/14 14:17:39 IncrementLimit(test) >03/25/14 14:17:39 IncrementLimit(medium.test) >03/25/14 14:17:39 IncrementLimit(test) >03/25/14 14:17:39 IncrementLimit(medium.test) >03/25/14 14:17:39 IncrementLimit(test) >03/25/14 14:17:39 IncrementLimit(medium.test) >03/25/14 14:17:39 IncrementLimit(undef.test) >03/25/14 14:17:39 IncrementLimit(medium.test) >03/25/14 14:17:39 IncrementLimit(undef) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 IncrementLimit(large.test) >03/25/14 14:17:39 Current Limits -- >03/25/14 14:17:39 Limit: test = 3.000000 >03/25/14 14:17:39 Limit: small.test = 2.000000 >03/25/14 14:17:39 Limit: medium.test = 5.000000 >03/25/14 14:17:39 Limit: undef.test = 1.000000 >03/25/14 14:17:39 Limit: undef = 1.000000 >03/25/14 14:17:39 Limit: large.test = 13.000000 >03/25/14 14:17:39 Limit: medium.undef = 5.000000 >03/25/14 14:17:39 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:17:39 Phase 4.1: Negotiating with schedds ... >03/25/14 14:17:39 numSlots = 30 >03/25/14 14:17:39 slotWeightTotal = 30.000000 >03/25/14 14:17:39 pieLeft = 0.000 >03/25/14 14:17:39 NormalFactor = 1.000000 >03/25/14 14:17:39 MaxPrioValue = 0.875202 >03/25/14 14:17:39 NumSubmitterAds = 1 >03/25/14 14:17:39 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:17:39 0 seconds so far >03/25/14 14:17:39 Calculating submitter limit with the following parameters >03/25/14 14:17:39 SubmitterPrio = 0.875202 >03/25/14 14:17:39 SubmitterPrioFactor = 1.000000 >03/25/14 14:17:39 submitterShare = 1.000000 >03/25/14 14:17:39 submitterAbsShare = 1.000000 >03/25/14 14:17:39 submitterLimit = 0.000000 >03/25/14 14:17:39 submitterUsage = 30.000000 >03/25/14 14:17:39 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:17:39 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00011: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: large.test is 13.000000 >03/25/14 14:17:39 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:17:39 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00025: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:17:39 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:39 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00042: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: small.test is 2.000000 >03/25/14 14:17:39 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:17:39 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00063: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: test is 3.000000 >03/25/14 14:17:39 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:17:39 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00081: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:17:39 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:39 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00101: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: undef is 1.000000 >03/25/14 14:17:39 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:39 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:39 Request 00001.00125: >03/25/14 14:17:39 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:39 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:17:39 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:39 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:17:39 Sending SEND_JOB_INFO/eom >03/25/14 14:17:39 Getting reply from schedd ... >03/25/14 14:17:39 Got NO_MORE_JOBS; done negotiating >03/25/14 14:17:39 This submitter hit its submitterLimit. >03/25/14 14:17:39 resources used scheddUsed= 30.000000 >03/25/14 14:17:39 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:17:39 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:17:39 Getting monitoring info for pid 22893 >03/25/14 14:17:40 Getting monitoring info for pid 22893 >03/25/14 14:17:41 Getting monitoring info for pid 22893 >03/25/14 14:17:42 Getting monitoring info for pid 22893 >03/25/14 14:17:43 Getting monitoring info for pid 22893 >03/25/14 14:17:44 Getting monitoring info for pid 22893 >03/25/14 14:17:45 Getting monitoring info for pid 22893 >03/25/14 14:17:46 Getting monitoring info for pid 22893 >03/25/14 14:17:47 Getting monitoring info for pid 22893 >03/25/14 14:17:48 Getting monitoring info for pid 22893 >03/25/14 14:17:49 Getting monitoring info for pid 22893 >03/25/14 14:17:50 Getting monitoring info for pid 22893 >03/25/14 14:17:51 Getting monitoring info for pid 22893 >03/25/14 14:17:52 Getting monitoring info for pid 22893 >03/25/14 14:17:53 Getting monitoring info for pid 22893 >03/25/14 14:17:54 Getting monitoring info for pid 22893 >03/25/14 14:17:55 Getting monitoring info for pid 22893 >03/25/14 14:17:56 Getting monitoring info for pid 22893 >03/25/14 14:17:57 Getting monitoring info for pid 22893 >03/25/14 14:17:58 Getting monitoring info for pid 22893 >03/25/14 14:17:59 ---------- Started Negotiation Cycle ---------- >03/25/14 14:17:59 Phase 1: Obtaining ads from collector ... >03/25/14 14:17:59 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:17:59 Trying to query collector <IP:9618> >03/25/14 14:17:59 Sorting 32 ads ... >03/25/14 14:17:59 Getting startd private ads ... >03/25/14 14:17:59 Trying to query collector <IP:9618> >03/25/14 14:17:59 Got ads: 32 public and 30 private >03/25/14 14:17:59 Public ads include 1 submitter, 30 startd >03/25/14 14:17:59 Phase 2: Performing accounting ... >03/25/14 14:17:59 Entering compute_significant_attrs() >03/25/14 14:17:59 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:17:59 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:17:59 CustomerName=Customer.<none> , Old Priority=0.875 , New Priority=0.880 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=48465.000 (unweighted 48465.000), BeginUsageTime=1395751882 >03/25/14 14:17:59 CustomerName=Customer.test@<hostname> , Old Priority=0.875 , New Priority=0.880 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:17:59 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=48465.000 (unweighted 48465.000), BeginUsageTime=1395751882 >03/25/14 14:17:59 (Accountant) Checking Matches >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:17:59 Match already existed! >03/25/14 14:17:59 Previous Limits -- >03/25/14 14:17:59 Limit: test = 3.000000 >03/25/14 14:17:59 Limit: small.test = 2.000000 >03/25/14 14:17:59 Limit: medium.test = 5.000000 >03/25/14 14:17:59 Limit: undef.test = 1.000000 >03/25/14 14:17:59 Limit: undef = 1.000000 >03/25/14 14:17:59 Limit: large.test = 13.000000 >03/25/14 14:17:59 Limit: medium.undef = 5.000000 >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(medium.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(medium.undef) >03/25/14 14:17:59 IncrementLimit(small.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(medium.undef) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(medium.undef) >03/25/14 14:17:59 IncrementLimit(medium.undef) >03/25/14 14:17:59 IncrementLimit(medium.undef) >03/25/14 14:17:59 IncrementLimit(small.test) >03/25/14 14:17:59 IncrementLimit(test) >03/25/14 14:17:59 IncrementLimit(medium.test) >03/25/14 14:17:59 IncrementLimit(test) >03/25/14 14:17:59 IncrementLimit(medium.test) >03/25/14 14:17:59 IncrementLimit(test) >03/25/14 14:17:59 IncrementLimit(medium.test) >03/25/14 14:17:59 IncrementLimit(undef.test) >03/25/14 14:17:59 IncrementLimit(medium.test) >03/25/14 14:17:59 IncrementLimit(undef) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 IncrementLimit(large.test) >03/25/14 14:17:59 Current Limits -- >03/25/14 14:17:59 Limit: test = 3.000000 >03/25/14 14:17:59 Limit: small.test = 2.000000 >03/25/14 14:17:59 Limit: medium.test = 5.000000 >03/25/14 14:17:59 Limit: undef.test = 1.000000 >03/25/14 14:17:59 Limit: undef = 1.000000 >03/25/14 14:17:59 Limit: large.test = 13.000000 >03/25/14 14:17:59 Limit: medium.undef = 5.000000 >03/25/14 14:17:59 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:17:59 Phase 4.1: Negotiating with schedds ... >03/25/14 14:17:59 numSlots = 30 >03/25/14 14:17:59 slotWeightTotal = 30.000000 >03/25/14 14:17:59 pieLeft = 0.000 >03/25/14 14:17:59 NormalFactor = 1.000000 >03/25/14 14:17:59 MaxPrioValue = 0.879875 >03/25/14 14:17:59 NumSubmitterAds = 1 >03/25/14 14:17:59 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:17:59 0 seconds so far >03/25/14 14:17:59 Calculating submitter limit with the following parameters >03/25/14 14:17:59 SubmitterPrio = 0.879875 >03/25/14 14:17:59 SubmitterPrioFactor = 1.000000 >03/25/14 14:17:59 submitterShare = 1.000000 >03/25/14 14:17:59 submitterAbsShare = 1.000000 >03/25/14 14:17:59 submitterLimit = 0.000000 >03/25/14 14:17:59 submitterUsage = 30.000000 >03/25/14 14:17:59 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:17:59 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00011: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: large.test is 13.000000 >03/25/14 14:17:59 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:17:59 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00025: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:17:59 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:59 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00042: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: small.test is 2.000000 >03/25/14 14:17:59 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:17:59 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00063: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: test is 3.000000 >03/25/14 14:17:59 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:17:59 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00081: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:17:59 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:59 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00101: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: undef is 1.000000 >03/25/14 14:17:59 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:17:59 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got JOB_INFO command; getting classad/eom >03/25/14 14:17:59 Request 00001.00125: >03/25/14 14:17:59 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:17:59 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:17:59 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:17:59 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:17:59 Sending SEND_JOB_INFO/eom >03/25/14 14:17:59 Getting reply from schedd ... >03/25/14 14:17:59 Got NO_MORE_JOBS; done negotiating >03/25/14 14:17:59 This submitter hit its submitterLimit. >03/25/14 14:17:59 resources used scheddUsed= 30.000000 >03/25/14 14:17:59 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:17:59 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:17:59 Getting monitoring info for pid 22893 >03/25/14 14:18:00 Getting monitoring info for pid 22893 >03/25/14 14:18:01 Getting monitoring info for pid 22893 >03/25/14 14:18:02 Getting monitoring info for pid 22893 >03/25/14 14:18:03 Getting monitoring info for pid 22893 >03/25/14 14:18:04 Getting monitoring info for pid 22893 >03/25/14 14:18:05 Getting monitoring info for pid 22893 >03/25/14 14:18:06 Getting monitoring info for pid 22893 >03/25/14 14:18:07 Getting monitoring info for pid 22893 >03/25/14 14:18:08 Getting monitoring info for pid 22893 >03/25/14 14:18:09 Getting monitoring info for pid 22893 >03/25/14 14:18:10 Getting monitoring info for pid 22893 >03/25/14 14:18:11 Getting monitoring info for pid 22893 >03/25/14 14:18:12 Getting monitoring info for pid 22893 >03/25/14 14:18:13 Getting monitoring info for pid 22893 >03/25/14 14:18:14 Getting monitoring info for pid 22893 >03/25/14 14:18:15 Getting monitoring info for pid 22893 >03/25/14 14:18:16 Getting monitoring info for pid 22893 >03/25/14 14:18:17 Getting monitoring info for pid 22893 >03/25/14 14:18:18 Getting monitoring info for pid 22893 >03/25/14 14:18:19 ---------- Started Negotiation Cycle ---------- >03/25/14 14:18:19 Phase 1: Obtaining ads from collector ... >03/25/14 14:18:19 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:18:19 Trying to query collector <IP:9618> >03/25/14 14:18:19 Sorting 32 ads ... >03/25/14 14:18:19 Getting startd private ads ... >03/25/14 14:18:19 Trying to query collector <IP:9618> >03/25/14 14:18:19 Got ads: 32 public and 30 private >03/25/14 14:18:19 Public ads include 1 submitter, 30 startd >03/25/14 14:18:19 Phase 2: Performing accounting ... >03/25/14 14:18:19 Entering compute_significant_attrs() >03/25/14 14:18:19 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:18:19 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:18:19 CustomerName=Customer.<none> , Old Priority=0.880 , New Priority=0.885 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:18:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=49065.000 (unweighted 49065.000), BeginUsageTime=1395751882 >03/25/14 14:18:19 CustomerName=Customer.test@<hostname> , Old Priority=0.880 , New Priority=0.885 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:18:19 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=49065.000 (unweighted 49065.000), BeginUsageTime=1395751882 >03/25/14 14:18:19 (Accountant) Checking Matches >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:18:19 Match already existed! >03/25/14 14:18:19 Previous Limits -- >03/25/14 14:18:19 Limit: test = 3.000000 >03/25/14 14:18:19 Limit: small.test = 2.000000 >03/25/14 14:18:19 Limit: medium.test = 5.000000 >03/25/14 14:18:19 Limit: undef.test = 1.000000 >03/25/14 14:18:19 Limit: undef = 1.000000 >03/25/14 14:18:19 Limit: large.test = 13.000000 >03/25/14 14:18:19 Limit: medium.undef = 5.000000 >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(medium.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(medium.undef) >03/25/14 14:18:19 IncrementLimit(small.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(medium.undef) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(medium.undef) >03/25/14 14:18:19 IncrementLimit(medium.undef) >03/25/14 14:18:19 IncrementLimit(medium.undef) >03/25/14 14:18:19 IncrementLimit(small.test) >03/25/14 14:18:19 IncrementLimit(test) >03/25/14 14:18:19 IncrementLimit(medium.test) >03/25/14 14:18:19 IncrementLimit(test) >03/25/14 14:18:19 IncrementLimit(medium.test) >03/25/14 14:18:19 IncrementLimit(test) >03/25/14 14:18:19 IncrementLimit(medium.test) >03/25/14 14:18:19 IncrementLimit(undef.test) >03/25/14 14:18:19 IncrementLimit(medium.test) >03/25/14 14:18:19 IncrementLimit(undef) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 IncrementLimit(large.test) >03/25/14 14:18:19 Current Limits -- >03/25/14 14:18:19 Limit: test = 3.000000 >03/25/14 14:18:19 Limit: small.test = 2.000000 >03/25/14 14:18:19 Limit: medium.test = 5.000000 >03/25/14 14:18:19 Limit: undef.test = 1.000000 >03/25/14 14:18:19 Limit: undef = 1.000000 >03/25/14 14:18:19 Limit: large.test = 13.000000 >03/25/14 14:18:19 Limit: medium.undef = 5.000000 >03/25/14 14:18:19 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:18:19 Phase 4.1: Negotiating with schedds ... >03/25/14 14:18:19 numSlots = 30 >03/25/14 14:18:19 slotWeightTotal = 30.000000 >03/25/14 14:18:19 pieLeft = 0.000 >03/25/14 14:18:19 NormalFactor = 1.000000 >03/25/14 14:18:19 MaxPrioValue = 0.884547 >03/25/14 14:18:19 NumSubmitterAds = 1 >03/25/14 14:18:19 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:18:19 0 seconds so far >03/25/14 14:18:19 Calculating submitter limit with the following parameters >03/25/14 14:18:19 SubmitterPrio = 0.884547 >03/25/14 14:18:19 SubmitterPrioFactor = 1.000000 >03/25/14 14:18:19 submitterShare = 1.000000 >03/25/14 14:18:19 submitterAbsShare = 1.000000 >03/25/14 14:18:19 submitterLimit = 0.000000 >03/25/14 14:18:19 submitterUsage = 30.000000 >03/25/14 14:18:19 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:18:19 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00011: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: large.test is 13.000000 >03/25/14 14:18:19 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:18:19 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00025: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:18:19 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:18:19 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00042: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: small.test is 2.000000 >03/25/14 14:18:19 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:18:19 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00063: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: test is 3.000000 >03/25/14 14:18:19 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:18:19 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00081: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:18:19 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:18:19 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00101: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: undef is 1.000000 >03/25/14 14:18:19 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:18:19 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:19 Request 00001.00125: >03/25/14 14:18:19 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:19 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:18:19 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:18:19 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:18:19 Sending SEND_JOB_INFO/eom >03/25/14 14:18:19 Getting reply from schedd ... >03/25/14 14:18:19 Got NO_MORE_JOBS; done negotiating >03/25/14 14:18:19 This submitter hit its submitterLimit. >03/25/14 14:18:19 resources used scheddUsed= 30.000000 >03/25/14 14:18:19 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:18:19 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:18:19 Getting monitoring info for pid 22893 >03/25/14 14:18:20 Getting monitoring info for pid 22893 >03/25/14 14:18:21 Getting monitoring info for pid 22893 >03/25/14 14:18:22 Getting monitoring info for pid 22893 >03/25/14 14:18:23 Getting monitoring info for pid 22893 >03/25/14 14:18:24 Getting monitoring info for pid 22893 >03/25/14 14:18:25 Getting monitoring info for pid 22893 >03/25/14 14:18:26 Getting monitoring info for pid 22893 >03/25/14 14:18:27 Getting monitoring info for pid 22893 >03/25/14 14:18:28 Getting monitoring info for pid 22893 >03/25/14 14:18:29 Getting monitoring info for pid 22893 >03/25/14 14:18:30 Getting monitoring info for pid 22893 >03/25/14 14:18:31 Getting monitoring info for pid 22893 >03/25/14 14:18:32 Getting monitoring info for pid 22893 >03/25/14 14:18:33 Getting monitoring info for pid 22893 >03/25/14 14:18:34 Getting monitoring info for pid 22893 >03/25/14 14:18:35 Getting monitoring info for pid 22893 >03/25/14 14:18:36 Getting monitoring info for pid 22893 >03/25/14 14:18:37 Getting monitoring info for pid 22893 >03/25/14 14:18:38 Getting monitoring info for pid 22893 >03/25/14 14:18:39 ---------- Started Negotiation Cycle ---------- >03/25/14 14:18:39 Phase 1: Obtaining ads from collector ... >03/25/14 14:18:39 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:18:39 Trying to query collector <IP:9618> >03/25/14 14:18:40 Sorting 32 ads ... >03/25/14 14:18:40 Getting startd private ads ... >03/25/14 14:18:40 Trying to query collector <IP:9618> >03/25/14 14:18:40 Got ads: 32 public and 30 private >03/25/14 14:18:40 Public ads include 1 submitter, 30 startd >03/25/14 14:18:40 Phase 2: Performing accounting ... >03/25/14 14:18:40 Entering compute_significant_attrs() >03/25/14 14:18:40 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:18:40 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:18:40 CustomerName=Customer.<none> , Old Priority=0.885 , New Priority=0.889 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:18:40 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=49695.000 (unweighted 49695.000), BeginUsageTime=1395751882 >03/25/14 14:18:40 CustomerName=Customer.test@<hostname> , Old Priority=0.885 , New Priority=0.889 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:18:40 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=49695.000 (unweighted 49695.000), BeginUsageTime=1395751882 >03/25/14 14:18:40 (Accountant) Checking Matches >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:18:40 Match already existed! >03/25/14 14:18:40 Previous Limits -- >03/25/14 14:18:40 Limit: test = 3.000000 >03/25/14 14:18:40 Limit: small.test = 2.000000 >03/25/14 14:18:40 Limit: medium.test = 5.000000 >03/25/14 14:18:40 Limit: undef.test = 1.000000 >03/25/14 14:18:40 Limit: undef = 1.000000 >03/25/14 14:18:40 Limit: large.test = 13.000000 >03/25/14 14:18:40 Limit: medium.undef = 5.000000 >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(medium.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(medium.undef) >03/25/14 14:18:40 IncrementLimit(small.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(medium.undef) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(medium.undef) >03/25/14 14:18:40 IncrementLimit(medium.undef) >03/25/14 14:18:40 IncrementLimit(medium.undef) >03/25/14 14:18:40 IncrementLimit(small.test) >03/25/14 14:18:40 IncrementLimit(test) >03/25/14 14:18:40 IncrementLimit(medium.test) >03/25/14 14:18:40 IncrementLimit(test) >03/25/14 14:18:40 IncrementLimit(medium.test) >03/25/14 14:18:40 IncrementLimit(test) >03/25/14 14:18:40 IncrementLimit(medium.test) >03/25/14 14:18:40 IncrementLimit(undef.test) >03/25/14 14:18:40 IncrementLimit(medium.test) >03/25/14 14:18:40 IncrementLimit(undef) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 IncrementLimit(large.test) >03/25/14 14:18:40 Current Limits -- >03/25/14 14:18:40 Limit: test = 3.000000 >03/25/14 14:18:40 Limit: small.test = 2.000000 >03/25/14 14:18:40 Limit: medium.test = 5.000000 >03/25/14 14:18:40 Limit: undef.test = 1.000000 >03/25/14 14:18:40 Limit: undef = 1.000000 >03/25/14 14:18:40 Limit: large.test = 13.000000 >03/25/14 14:18:40 Limit: medium.undef = 5.000000 >03/25/14 14:18:40 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:18:40 Phase 4.1: Negotiating with schedds ... >03/25/14 14:18:40 numSlots = 30 >03/25/14 14:18:40 slotWeightTotal = 30.000000 >03/25/14 14:18:40 pieLeft = 0.000 >03/25/14 14:18:40 NormalFactor = 1.000000 >03/25/14 14:18:40 MaxPrioValue = 0.889451 >03/25/14 14:18:40 NumSubmitterAds = 1 >03/25/14 14:18:40 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:18:40 0 seconds so far >03/25/14 14:18:40 Calculating submitter limit with the following parameters >03/25/14 14:18:40 SubmitterPrio = 0.889451 >03/25/14 14:18:40 SubmitterPrioFactor = 1.000000 >03/25/14 14:18:40 submitterShare = 1.000000 >03/25/14 14:18:40 submitterAbsShare = 1.000000 >03/25/14 14:18:40 submitterLimit = 0.000000 >03/25/14 14:18:40 submitterUsage = 30.000000 >03/25/14 14:18:40 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:18:40 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00011: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: large.test is 13.000000 >03/25/14 14:18:40 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:18:40 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00025: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:18:40 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:18:40 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00042: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: small.test is 2.000000 >03/25/14 14:18:40 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:18:40 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00063: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: test is 3.000000 >03/25/14 14:18:40 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:18:40 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00081: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:18:40 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:18:40 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00101: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: undef is 1.000000 >03/25/14 14:18:40 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:18:40 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:18:40 Request 00001.00125: >03/25/14 14:18:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:18:40 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:18:40 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:18:40 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:18:40 Sending SEND_JOB_INFO/eom >03/25/14 14:18:40 Getting reply from schedd ... >03/25/14 14:18:40 Got NO_MORE_JOBS; done negotiating >03/25/14 14:18:40 This submitter hit its submitterLimit. >03/25/14 14:18:40 resources used scheddUsed= 30.000000 >03/25/14 14:18:40 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:18:40 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:18:40 Getting monitoring info for pid 22893 >03/25/14 14:18:41 Getting monitoring info for pid 22893 >03/25/14 14:18:42 Getting monitoring info for pid 22893 >03/25/14 14:18:43 Getting monitoring info for pid 22893 >03/25/14 14:18:44 Getting monitoring info for pid 22893 >03/25/14 14:18:45 Getting monitoring info for pid 22893 >03/25/14 14:18:46 Getting monitoring info for pid 22893 >03/25/14 14:18:47 Getting monitoring info for pid 22893 >03/25/14 14:18:48 Getting monitoring info for pid 22893 >03/25/14 14:18:49 Getting monitoring info for pid 22893 >03/25/14 14:18:50 Getting monitoring info for pid 22893 >03/25/14 14:18:51 Getting monitoring info for pid 22893 >03/25/14 14:18:52 Getting monitoring info for pid 22893 >03/25/14 14:18:53 Getting monitoring info for pid 22893 >03/25/14 14:18:54 Getting monitoring info for pid 22893 >03/25/14 14:18:55 Getting monitoring info for pid 22893 >03/25/14 14:18:56 Getting monitoring info for pid 22893 >03/25/14 14:18:57 Getting monitoring info for pid 22893 >03/25/14 14:18:58 Getting monitoring info for pid 22893 >03/25/14 14:18:59 Getting monitoring info for pid 22893 >03/25/14 14:19:00 ---------- Started Negotiation Cycle ---------- >03/25/14 14:19:00 Phase 1: Obtaining ads from collector ... >03/25/14 14:19:00 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:19:00 Trying to query collector <IP:9618> >03/25/14 14:19:00 Sorting 32 ads ... >03/25/14 14:19:00 Getting startd private ads ... >03/25/14 14:19:00 Trying to query collector <IP:9618> >03/25/14 14:19:00 Got ads: 32 public and 30 private >03/25/14 14:19:00 Public ads include 1 submitter, 30 startd >03/25/14 14:19:00 Phase 2: Performing accounting ... >03/25/14 14:19:00 Entering compute_significant_attrs() >03/25/14 14:19:00 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:19:00 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:19:00 CustomerName=Customer.<none> , Old Priority=0.889 , New Priority=0.894 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:00 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=50295.000 (unweighted 50295.000), BeginUsageTime=1395751882 >03/25/14 14:19:00 CustomerName=Customer.test@<hostname> , Old Priority=0.889 , New Priority=0.894 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:00 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=50295.000 (unweighted 50295.000), BeginUsageTime=1395751882 >03/25/14 14:19:00 (Accountant) Checking Matches >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:19:00 Match already existed! >03/25/14 14:19:00 Previous Limits -- >03/25/14 14:19:00 Limit: test = 3.000000 >03/25/14 14:19:00 Limit: small.test = 2.000000 >03/25/14 14:19:00 Limit: medium.test = 5.000000 >03/25/14 14:19:00 Limit: undef.test = 1.000000 >03/25/14 14:19:00 Limit: undef = 1.000000 >03/25/14 14:19:00 Limit: large.test = 13.000000 >03/25/14 14:19:00 Limit: medium.undef = 5.000000 >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(medium.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(medium.undef) >03/25/14 14:19:00 IncrementLimit(small.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(medium.undef) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(medium.undef) >03/25/14 14:19:00 IncrementLimit(medium.undef) >03/25/14 14:19:00 IncrementLimit(medium.undef) >03/25/14 14:19:00 IncrementLimit(small.test) >03/25/14 14:19:00 IncrementLimit(test) >03/25/14 14:19:00 IncrementLimit(medium.test) >03/25/14 14:19:00 IncrementLimit(test) >03/25/14 14:19:00 IncrementLimit(medium.test) >03/25/14 14:19:00 IncrementLimit(test) >03/25/14 14:19:00 IncrementLimit(medium.test) >03/25/14 14:19:00 IncrementLimit(undef.test) >03/25/14 14:19:00 IncrementLimit(medium.test) >03/25/14 14:19:00 IncrementLimit(undef) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 IncrementLimit(large.test) >03/25/14 14:19:00 Current Limits -- >03/25/14 14:19:00 Limit: test = 3.000000 >03/25/14 14:19:00 Limit: small.test = 2.000000 >03/25/14 14:19:00 Limit: medium.test = 5.000000 >03/25/14 14:19:00 Limit: undef.test = 1.000000 >03/25/14 14:19:00 Limit: undef = 1.000000 >03/25/14 14:19:00 Limit: large.test = 13.000000 >03/25/14 14:19:00 Limit: medium.undef = 5.000000 >03/25/14 14:19:00 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:19:00 Phase 4.1: Negotiating with schedds ... >03/25/14 14:19:00 numSlots = 30 >03/25/14 14:19:00 slotWeightTotal = 30.000000 >03/25/14 14:19:00 pieLeft = 0.000 >03/25/14 14:19:00 NormalFactor = 1.000000 >03/25/14 14:19:00 MaxPrioValue = 0.894122 >03/25/14 14:19:00 NumSubmitterAds = 1 >03/25/14 14:19:00 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:19:00 0 seconds so far >03/25/14 14:19:00 Calculating submitter limit with the following parameters >03/25/14 14:19:00 SubmitterPrio = 0.894122 >03/25/14 14:19:00 SubmitterPrioFactor = 1.000000 >03/25/14 14:19:00 submitterShare = 1.000000 >03/25/14 14:19:00 submitterAbsShare = 1.000000 >03/25/14 14:19:00 submitterLimit = 0.000000 >03/25/14 14:19:00 submitterUsage = 30.000000 >03/25/14 14:19:00 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:19:00 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00011: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: large.test is 13.000000 >03/25/14 14:19:00 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:19:00 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00025: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:19:00 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:00 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00042: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: small.test is 2.000000 >03/25/14 14:19:00 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:19:00 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00063: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: test is 3.000000 >03/25/14 14:19:00 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:19:00 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00081: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:19:00 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:00 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00101: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: undef is 1.000000 >03/25/14 14:19:00 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:00 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:00 Request 00001.00125: >03/25/14 14:19:00 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:00 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:19:00 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:00 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:19:00 Sending SEND_JOB_INFO/eom >03/25/14 14:19:00 Getting reply from schedd ... >03/25/14 14:19:00 Got NO_MORE_JOBS; done negotiating >03/25/14 14:19:00 This submitter hit its submitterLimit. >03/25/14 14:19:00 resources used scheddUsed= 30.000000 >03/25/14 14:19:00 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:19:00 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:19:00 Getting monitoring info for pid 22893 >03/25/14 14:19:01 Getting monitoring info for pid 22893 >03/25/14 14:19:02 Getting monitoring info for pid 22893 >03/25/14 14:19:03 Getting monitoring info for pid 22893 >03/25/14 14:19:04 Getting monitoring info for pid 22893 >03/25/14 14:19:05 Getting monitoring info for pid 22893 >03/25/14 14:19:06 Getting monitoring info for pid 22893 >03/25/14 14:19:07 Getting monitoring info for pid 22893 >03/25/14 14:19:08 Getting monitoring info for pid 22893 >03/25/14 14:19:09 Getting monitoring info for pid 22893 >03/25/14 14:19:10 Getting monitoring info for pid 22893 >03/25/14 14:19:11 Getting monitoring info for pid 22893 >03/25/14 14:19:12 Getting monitoring info for pid 22893 >03/25/14 14:19:13 Getting monitoring info for pid 22893 >03/25/14 14:19:14 Getting monitoring info for pid 22893 >03/25/14 14:19:15 Getting monitoring info for pid 22893 >03/25/14 14:19:16 Getting monitoring info for pid 22893 >03/25/14 14:19:17 Getting monitoring info for pid 22893 >03/25/14 14:19:18 Getting monitoring info for pid 22893 >03/25/14 14:19:19 Getting monitoring info for pid 22893 >03/25/14 14:19:20 ---------- Started Negotiation Cycle ---------- >03/25/14 14:19:20 Phase 1: Obtaining ads from collector ... >03/25/14 14:19:20 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:19:20 Trying to query collector <IP:9618> >03/25/14 14:19:20 Sorting 32 ads ... >03/25/14 14:19:20 Getting startd private ads ... >03/25/14 14:19:20 Trying to query collector <IP:9618> >03/25/14 14:19:20 Got ads: 32 public and 30 private >03/25/14 14:19:20 Public ads include 1 submitter, 30 startd >03/25/14 14:19:20 Phase 2: Performing accounting ... >03/25/14 14:19:20 Entering compute_significant_attrs() >03/25/14 14:19:20 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:19:20 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:19:20 CustomerName=Customer.<none> , Old Priority=0.894 , New Priority=0.899 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:20 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=50895.000 (unweighted 50895.000), BeginUsageTime=1395751882 >03/25/14 14:19:20 CustomerName=Customer.test@<hostname> , Old Priority=0.894 , New Priority=0.899 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:20 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=50895.000 (unweighted 50895.000), BeginUsageTime=1395751882 >03/25/14 14:19:20 (Accountant) Checking Matches >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:19:20 Match already existed! >03/25/14 14:19:20 Previous Limits -- >03/25/14 14:19:20 Limit: test = 3.000000 >03/25/14 14:19:20 Limit: small.test = 2.000000 >03/25/14 14:19:20 Limit: medium.test = 5.000000 >03/25/14 14:19:20 Limit: undef.test = 1.000000 >03/25/14 14:19:20 Limit: undef = 1.000000 >03/25/14 14:19:20 Limit: large.test = 13.000000 >03/25/14 14:19:20 Limit: medium.undef = 5.000000 >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(medium.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(medium.undef) >03/25/14 14:19:20 IncrementLimit(small.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(medium.undef) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(medium.undef) >03/25/14 14:19:20 IncrementLimit(medium.undef) >03/25/14 14:19:20 IncrementLimit(medium.undef) >03/25/14 14:19:20 IncrementLimit(small.test) >03/25/14 14:19:20 IncrementLimit(test) >03/25/14 14:19:20 IncrementLimit(medium.test) >03/25/14 14:19:20 IncrementLimit(test) >03/25/14 14:19:20 IncrementLimit(medium.test) >03/25/14 14:19:20 IncrementLimit(test) >03/25/14 14:19:20 IncrementLimit(medium.test) >03/25/14 14:19:20 IncrementLimit(undef.test) >03/25/14 14:19:20 IncrementLimit(medium.test) >03/25/14 14:19:20 IncrementLimit(undef) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 IncrementLimit(large.test) >03/25/14 14:19:20 Current Limits -- >03/25/14 14:19:20 Limit: test = 3.000000 >03/25/14 14:19:20 Limit: small.test = 2.000000 >03/25/14 14:19:20 Limit: medium.test = 5.000000 >03/25/14 14:19:20 Limit: undef.test = 1.000000 >03/25/14 14:19:20 Limit: undef = 1.000000 >03/25/14 14:19:20 Limit: large.test = 13.000000 >03/25/14 14:19:20 Limit: medium.undef = 5.000000 >03/25/14 14:19:20 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:19:20 Phase 4.1: Negotiating with schedds ... >03/25/14 14:19:20 numSlots = 30 >03/25/14 14:19:20 slotWeightTotal = 30.000000 >03/25/14 14:19:20 pieLeft = 0.000 >03/25/14 14:19:20 NormalFactor = 1.000000 >03/25/14 14:19:20 MaxPrioValue = 0.898792 >03/25/14 14:19:20 NumSubmitterAds = 1 >03/25/14 14:19:20 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:19:20 0 seconds so far >03/25/14 14:19:20 Calculating submitter limit with the following parameters >03/25/14 14:19:20 SubmitterPrio = 0.898792 >03/25/14 14:19:20 SubmitterPrioFactor = 1.000000 >03/25/14 14:19:20 submitterShare = 1.000000 >03/25/14 14:19:20 submitterAbsShare = 1.000000 >03/25/14 14:19:20 submitterLimit = 0.000000 >03/25/14 14:19:20 submitterUsage = 30.000000 >03/25/14 14:19:20 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:19:20 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00011: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: large.test is 13.000000 >03/25/14 14:19:20 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:19:20 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00025: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:19:20 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:20 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00042: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: small.test is 2.000000 >03/25/14 14:19:20 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:19:20 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00063: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: test is 3.000000 >03/25/14 14:19:20 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:19:20 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00081: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:19:20 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:20 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00101: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: undef is 1.000000 >03/25/14 14:19:20 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:20 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:20 Request 00001.00125: >03/25/14 14:19:20 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:20 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:19:20 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:20 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:19:20 Sending SEND_JOB_INFO/eom >03/25/14 14:19:20 Getting reply from schedd ... >03/25/14 14:19:20 Got NO_MORE_JOBS; done negotiating >03/25/14 14:19:20 This submitter hit its submitterLimit. >03/25/14 14:19:20 resources used scheddUsed= 30.000000 >03/25/14 14:19:20 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:19:20 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:19:20 Getting monitoring info for pid 22893 >03/25/14 14:19:21 Getting monitoring info for pid 22893 >03/25/14 14:19:22 Getting monitoring info for pid 22893 >03/25/14 14:19:23 Getting monitoring info for pid 22893 >03/25/14 14:19:24 Getting monitoring info for pid 22893 >03/25/14 14:19:25 Getting monitoring info for pid 22893 >03/25/14 14:19:26 Getting monitoring info for pid 22893 >03/25/14 14:19:27 Getting monitoring info for pid 22893 >03/25/14 14:19:28 Getting monitoring info for pid 22893 >03/25/14 14:19:29 Getting monitoring info for pid 22893 >03/25/14 14:19:30 Getting monitoring info for pid 22893 >03/25/14 14:19:31 Getting monitoring info for pid 22893 >03/25/14 14:19:32 Getting monitoring info for pid 22893 >03/25/14 14:19:33 Getting monitoring info for pid 22893 >03/25/14 14:19:34 Getting monitoring info for pid 22893 >03/25/14 14:19:35 Getting monitoring info for pid 22893 >03/25/14 14:19:36 Getting monitoring info for pid 22893 >03/25/14 14:19:37 Getting monitoring info for pid 22893 >03/25/14 14:19:38 Getting monitoring info for pid 22893 >03/25/14 14:19:39 Getting monitoring info for pid 22893 >03/25/14 14:19:40 ---------- Started Negotiation Cycle ---------- >03/25/14 14:19:40 Phase 1: Obtaining ads from collector ... >03/25/14 14:19:40 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:19:40 Trying to query collector <IP:9618> >03/25/14 14:19:40 Sorting 32 ads ... >03/25/14 14:19:40 Getting startd private ads ... >03/25/14 14:19:40 Trying to query collector <IP:9618> >03/25/14 14:19:40 Got ads: 32 public and 30 private >03/25/14 14:19:40 Public ads include 1 submitter, 30 startd >03/25/14 14:19:40 Phase 2: Performing accounting ... >03/25/14 14:19:40 Entering compute_significant_attrs() >03/25/14 14:19:40 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:19:40 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:19:40 CustomerName=Customer.<none> , Old Priority=0.899 , New Priority=0.903 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:40 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=51495.000 (unweighted 51495.000), BeginUsageTime=1395751882 >03/25/14 14:19:40 CustomerName=Customer.test@<hostname> , Old Priority=0.899 , New Priority=0.903 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:19:40 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=51495.000 (unweighted 51495.000), BeginUsageTime=1395751882 >03/25/14 14:19:40 (Accountant) Checking Matches >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:19:40 Match already existed! >03/25/14 14:19:40 Previous Limits -- >03/25/14 14:19:40 Limit: test = 3.000000 >03/25/14 14:19:40 Limit: small.test = 2.000000 >03/25/14 14:19:40 Limit: medium.test = 5.000000 >03/25/14 14:19:40 Limit: undef.test = 1.000000 >03/25/14 14:19:40 Limit: undef = 1.000000 >03/25/14 14:19:40 Limit: large.test = 13.000000 >03/25/14 14:19:40 Limit: medium.undef = 5.000000 >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(medium.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(medium.undef) >03/25/14 14:19:40 IncrementLimit(small.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(medium.undef) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(medium.undef) >03/25/14 14:19:40 IncrementLimit(medium.undef) >03/25/14 14:19:40 IncrementLimit(medium.undef) >03/25/14 14:19:40 IncrementLimit(small.test) >03/25/14 14:19:40 IncrementLimit(test) >03/25/14 14:19:40 IncrementLimit(medium.test) >03/25/14 14:19:40 IncrementLimit(test) >03/25/14 14:19:40 IncrementLimit(medium.test) >03/25/14 14:19:40 IncrementLimit(test) >03/25/14 14:19:40 IncrementLimit(medium.test) >03/25/14 14:19:40 IncrementLimit(undef.test) >03/25/14 14:19:40 IncrementLimit(medium.test) >03/25/14 14:19:40 IncrementLimit(undef) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 IncrementLimit(large.test) >03/25/14 14:19:40 Current Limits -- >03/25/14 14:19:40 Limit: test = 3.000000 >03/25/14 14:19:40 Limit: small.test = 2.000000 >03/25/14 14:19:40 Limit: medium.test = 5.000000 >03/25/14 14:19:40 Limit: undef.test = 1.000000 >03/25/14 14:19:40 Limit: undef = 1.000000 >03/25/14 14:19:40 Limit: large.test = 13.000000 >03/25/14 14:19:40 Limit: medium.undef = 5.000000 >03/25/14 14:19:40 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:19:40 Phase 4.1: Negotiating with schedds ... >03/25/14 14:19:40 numSlots = 30 >03/25/14 14:19:40 slotWeightTotal = 30.000000 >03/25/14 14:19:40 pieLeft = 0.000 >03/25/14 14:19:40 NormalFactor = 1.000000 >03/25/14 14:19:40 MaxPrioValue = 0.903461 >03/25/14 14:19:40 NumSubmitterAds = 1 >03/25/14 14:19:40 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:19:40 0 seconds so far >03/25/14 14:19:40 Calculating submitter limit with the following parameters >03/25/14 14:19:40 SubmitterPrio = 0.903461 >03/25/14 14:19:40 SubmitterPrioFactor = 1.000000 >03/25/14 14:19:40 submitterShare = 1.000000 >03/25/14 14:19:40 submitterAbsShare = 1.000000 >03/25/14 14:19:40 submitterLimit = 0.000000 >03/25/14 14:19:40 submitterUsage = 30.000000 >03/25/14 14:19:40 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:19:40 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00011: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: large.test is 13.000000 >03/25/14 14:19:40 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:19:40 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00025: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:19:40 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:40 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00042: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: small.test is 2.000000 >03/25/14 14:19:40 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:19:40 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00063: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: test is 3.000000 >03/25/14 14:19:40 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:19:40 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00081: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:19:40 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:40 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00101: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: undef is 1.000000 >03/25/14 14:19:40 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:19:40 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got JOB_INFO command; getting classad/eom >03/25/14 14:19:40 Request 00001.00125: >03/25/14 14:19:40 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:19:40 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:19:40 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:19:40 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:19:40 Sending SEND_JOB_INFO/eom >03/25/14 14:19:40 Getting reply from schedd ... >03/25/14 14:19:40 Got NO_MORE_JOBS; done negotiating >03/25/14 14:19:40 This submitter hit its submitterLimit. >03/25/14 14:19:40 resources used scheddUsed= 30.000000 >03/25/14 14:19:40 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:19:40 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:19:40 Getting monitoring info for pid 22893 >03/25/14 14:19:41 Getting monitoring info for pid 22893 >03/25/14 14:19:42 Getting monitoring info for pid 22893 >03/25/14 14:19:43 Getting monitoring info for pid 22893 >03/25/14 14:19:44 Getting monitoring info for pid 22893 >03/25/14 14:19:45 Getting monitoring info for pid 22893 >03/25/14 14:19:46 Getting monitoring info for pid 22893 >03/25/14 14:19:47 Getting monitoring info for pid 22893 >03/25/14 14:19:48 Getting monitoring info for pid 22893 >03/25/14 14:19:49 Getting monitoring info for pid 22893 >03/25/14 14:19:50 Getting monitoring info for pid 22893 >03/25/14 14:19:51 Getting monitoring info for pid 22893 >03/25/14 14:19:52 Getting monitoring info for pid 22893 >03/25/14 14:19:53 Getting monitoring info for pid 22893 >03/25/14 14:19:54 Getting monitoring info for pid 22893 >03/25/14 14:19:55 Getting monitoring info for pid 22893 >03/25/14 14:19:56 Getting monitoring info for pid 22893 >03/25/14 14:19:57 Getting monitoring info for pid 22893 >03/25/14 14:19:58 Getting monitoring info for pid 22893 >03/25/14 14:19:59 Getting monitoring info for pid 22893 >03/25/14 14:20:00 ---------- Started Negotiation Cycle ---------- >03/25/14 14:20:00 Phase 1: Obtaining ads from collector ... >03/25/14 14:20:00 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:20:00 Trying to query collector <IP:9618> >03/25/14 14:20:00 Sorting 32 ads ... >03/25/14 14:20:00 Getting startd private ads ... >03/25/14 14:20:00 Trying to query collector <IP:9618> >03/25/14 14:20:00 Got ads: 32 public and 30 private >03/25/14 14:20:00 Public ads include 1 submitter, 30 startd >03/25/14 14:20:00 Phase 2: Performing accounting ... >03/25/14 14:20:00 Entering compute_significant_attrs() >03/25/14 14:20:00 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:20:00 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:20:00 CustomerName=Customer.<none> , Old Priority=0.903 , New Priority=0.908 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:00 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=52095.000 (unweighted 52095.000), BeginUsageTime=1395751882 >03/25/14 14:20:00 CustomerName=Customer.test@<hostname> , Old Priority=0.903 , New Priority=0.908 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:00 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=52095.000 (unweighted 52095.000), BeginUsageTime=1395751882 >03/25/14 14:20:01 (Accountant) Checking Matches >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:20:01 Match already existed! >03/25/14 14:20:01 Previous Limits -- >03/25/14 14:20:01 Limit: test = 3.000000 >03/25/14 14:20:01 Limit: small.test = 2.000000 >03/25/14 14:20:01 Limit: medium.test = 5.000000 >03/25/14 14:20:01 Limit: undef.test = 1.000000 >03/25/14 14:20:01 Limit: undef = 1.000000 >03/25/14 14:20:01 Limit: large.test = 13.000000 >03/25/14 14:20:01 Limit: medium.undef = 5.000000 >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(medium.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(medium.undef) >03/25/14 14:20:01 IncrementLimit(small.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(medium.undef) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(medium.undef) >03/25/14 14:20:01 IncrementLimit(medium.undef) >03/25/14 14:20:01 IncrementLimit(medium.undef) >03/25/14 14:20:01 IncrementLimit(small.test) >03/25/14 14:20:01 IncrementLimit(test) >03/25/14 14:20:01 IncrementLimit(medium.test) >03/25/14 14:20:01 IncrementLimit(test) >03/25/14 14:20:01 IncrementLimit(medium.test) >03/25/14 14:20:01 IncrementLimit(test) >03/25/14 14:20:01 IncrementLimit(medium.test) >03/25/14 14:20:01 IncrementLimit(undef.test) >03/25/14 14:20:01 IncrementLimit(medium.test) >03/25/14 14:20:01 IncrementLimit(undef) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 IncrementLimit(large.test) >03/25/14 14:20:01 Current Limits -- >03/25/14 14:20:01 Limit: test = 3.000000 >03/25/14 14:20:01 Limit: small.test = 2.000000 >03/25/14 14:20:01 Limit: medium.test = 5.000000 >03/25/14 14:20:01 Limit: undef.test = 1.000000 >03/25/14 14:20:01 Limit: undef = 1.000000 >03/25/14 14:20:01 Limit: large.test = 13.000000 >03/25/14 14:20:01 Limit: medium.undef = 5.000000 >03/25/14 14:20:01 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:20:01 Phase 4.1: Negotiating with schedds ... >03/25/14 14:20:01 numSlots = 30 >03/25/14 14:20:01 slotWeightTotal = 30.000000 >03/25/14 14:20:01 pieLeft = 0.000 >03/25/14 14:20:01 NormalFactor = 1.000000 >03/25/14 14:20:01 MaxPrioValue = 0.908130 >03/25/14 14:20:01 NumSubmitterAds = 1 >03/25/14 14:20:01 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:20:01 0 seconds so far >03/25/14 14:20:01 Calculating submitter limit with the following parameters >03/25/14 14:20:01 SubmitterPrio = 0.908130 >03/25/14 14:20:01 SubmitterPrioFactor = 1.000000 >03/25/14 14:20:01 submitterShare = 1.000000 >03/25/14 14:20:01 submitterAbsShare = 1.000000 >03/25/14 14:20:01 submitterLimit = 0.000000 >03/25/14 14:20:01 submitterUsage = 30.000000 >03/25/14 14:20:01 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:20:01 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00011: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: large.test is 13.000000 >03/25/14 14:20:01 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:20:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00025: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:20:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00042: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: small.test is 2.000000 >03/25/14 14:20:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:20:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00063: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: test is 3.000000 >03/25/14 14:20:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:20:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00081: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:20:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00101: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: undef is 1.000000 >03/25/14 14:20:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:01 Request 00001.00125: >03/25/14 14:20:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:20:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:20:01 Sending SEND_JOB_INFO/eom >03/25/14 14:20:01 Getting reply from schedd ... >03/25/14 14:20:01 Got NO_MORE_JOBS; done negotiating >03/25/14 14:20:01 This submitter hit its submitterLimit. >03/25/14 14:20:01 resources used scheddUsed= 30.000000 >03/25/14 14:20:01 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:20:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:20:01 Getting monitoring info for pid 22893 >03/25/14 14:20:02 Getting monitoring info for pid 22893 >03/25/14 14:20:03 Getting monitoring info for pid 22893 >03/25/14 14:20:04 Getting monitoring info for pid 22893 >03/25/14 14:20:05 Getting monitoring info for pid 22893 >03/25/14 14:20:06 Getting monitoring info for pid 22893 >03/25/14 14:20:07 Getting monitoring info for pid 22893 >03/25/14 14:20:08 Getting monitoring info for pid 22893 >03/25/14 14:20:09 Getting monitoring info for pid 22893 >03/25/14 14:20:10 Getting monitoring info for pid 22893 >03/25/14 14:20:11 Getting monitoring info for pid 22893 >03/25/14 14:20:12 Getting monitoring info for pid 22893 >03/25/14 14:20:13 Getting monitoring info for pid 22893 >03/25/14 14:20:14 Getting monitoring info for pid 22893 >03/25/14 14:20:15 Getting monitoring info for pid 22893 >03/25/14 14:20:16 Getting monitoring info for pid 22893 >03/25/14 14:20:17 Getting monitoring info for pid 22893 >03/25/14 14:20:18 Getting monitoring info for pid 22893 >03/25/14 14:20:19 Getting monitoring info for pid 22893 >03/25/14 14:20:20 Getting monitoring info for pid 22893 >03/25/14 14:20:21 ---------- Started Negotiation Cycle ---------- >03/25/14 14:20:21 Phase 1: Obtaining ads from collector ... >03/25/14 14:20:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:20:21 Trying to query collector <IP:9618> >03/25/14 14:20:21 Sorting 32 ads ... >03/25/14 14:20:21 Getting startd private ads ... >03/25/14 14:20:21 Trying to query collector <IP:9618> >03/25/14 14:20:21 Got ads: 32 public and 30 private >03/25/14 14:20:21 Public ads include 1 submitter, 30 startd >03/25/14 14:20:21 Phase 2: Performing accounting ... >03/25/14 14:20:21 Entering compute_significant_attrs() >03/25/14 14:20:21 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:20:21 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:20:21 CustomerName=Customer.<none> , Old Priority=0.908 , New Priority=0.913 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=52725.000 (unweighted 52725.000), BeginUsageTime=1395751882 >03/25/14 14:20:21 CustomerName=Customer.test@<hostname> , Old Priority=0.908 , New Priority=0.913 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=52725.000 (unweighted 52725.000), BeginUsageTime=1395751882 >03/25/14 14:20:21 (Accountant) Checking Matches >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:20:21 Match already existed! >03/25/14 14:20:21 Previous Limits -- >03/25/14 14:20:21 Limit: test = 3.000000 >03/25/14 14:20:21 Limit: small.test = 2.000000 >03/25/14 14:20:21 Limit: medium.test = 5.000000 >03/25/14 14:20:21 Limit: undef.test = 1.000000 >03/25/14 14:20:21 Limit: undef = 1.000000 >03/25/14 14:20:21 Limit: large.test = 13.000000 >03/25/14 14:20:21 Limit: medium.undef = 5.000000 >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(medium.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(medium.undef) >03/25/14 14:20:21 IncrementLimit(small.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(medium.undef) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(medium.undef) >03/25/14 14:20:21 IncrementLimit(medium.undef) >03/25/14 14:20:21 IncrementLimit(medium.undef) >03/25/14 14:20:21 IncrementLimit(small.test) >03/25/14 14:20:21 IncrementLimit(test) >03/25/14 14:20:21 IncrementLimit(medium.test) >03/25/14 14:20:21 IncrementLimit(test) >03/25/14 14:20:21 IncrementLimit(medium.test) >03/25/14 14:20:21 IncrementLimit(test) >03/25/14 14:20:21 IncrementLimit(medium.test) >03/25/14 14:20:21 IncrementLimit(undef.test) >03/25/14 14:20:21 IncrementLimit(medium.test) >03/25/14 14:20:21 IncrementLimit(undef) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 IncrementLimit(large.test) >03/25/14 14:20:21 Current Limits -- >03/25/14 14:20:21 Limit: test = 3.000000 >03/25/14 14:20:21 Limit: small.test = 2.000000 >03/25/14 14:20:21 Limit: medium.test = 5.000000 >03/25/14 14:20:21 Limit: undef.test = 1.000000 >03/25/14 14:20:21 Limit: undef = 1.000000 >03/25/14 14:20:21 Limit: large.test = 13.000000 >03/25/14 14:20:21 Limit: medium.undef = 5.000000 >03/25/14 14:20:21 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:20:21 Phase 4.1: Negotiating with schedds ... >03/25/14 14:20:21 numSlots = 30 >03/25/14 14:20:21 slotWeightTotal = 30.000000 >03/25/14 14:20:21 pieLeft = 0.000 >03/25/14 14:20:21 NormalFactor = 1.000000 >03/25/14 14:20:21 MaxPrioValue = 0.913030 >03/25/14 14:20:21 NumSubmitterAds = 1 >03/25/14 14:20:21 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:20:21 0 seconds so far >03/25/14 14:20:21 Calculating submitter limit with the following parameters >03/25/14 14:20:21 SubmitterPrio = 0.913030 >03/25/14 14:20:21 SubmitterPrioFactor = 1.000000 >03/25/14 14:20:21 submitterShare = 1.000000 >03/25/14 14:20:21 submitterAbsShare = 1.000000 >03/25/14 14:20:21 submitterLimit = 0.000000 >03/25/14 14:20:21 submitterUsage = 30.000000 >03/25/14 14:20:21 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:20:21 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00011: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: large.test is 13.000000 >03/25/14 14:20:21 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:20:21 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00025: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:20:21 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:21 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00042: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: small.test is 2.000000 >03/25/14 14:20:21 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:20:21 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00063: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: test is 3.000000 >03/25/14 14:20:21 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:20:21 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00081: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:20:21 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:21 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00101: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: undef is 1.000000 >03/25/14 14:20:21 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:21 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:21 Request 00001.00125: >03/25/14 14:20:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:21 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:20:21 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:21 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:20:21 Sending SEND_JOB_INFO/eom >03/25/14 14:20:21 Getting reply from schedd ... >03/25/14 14:20:21 Got NO_MORE_JOBS; done negotiating >03/25/14 14:20:21 This submitter hit its submitterLimit. >03/25/14 14:20:21 resources used scheddUsed= 30.000000 >03/25/14 14:20:21 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:20:21 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:20:21 Getting monitoring info for pid 22893 >03/25/14 14:20:22 Getting monitoring info for pid 22893 >03/25/14 14:20:23 Getting monitoring info for pid 22893 >03/25/14 14:20:24 Getting monitoring info for pid 22893 >03/25/14 14:20:25 Getting monitoring info for pid 22893 >03/25/14 14:20:26 Getting monitoring info for pid 22893 >03/25/14 14:20:27 Getting monitoring info for pid 22893 >03/25/14 14:20:28 Getting monitoring info for pid 22893 >03/25/14 14:20:29 Getting monitoring info for pid 22893 >03/25/14 14:20:30 enter Matchmaker::updateCollector >03/25/14 14:20:30 Warning: Could not find DaemonStartTime >03/25/14 14:20:30 Trying to update collector <IP:9618> >03/25/14 14:20:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:20:30 exit Matchmaker::UpdateCollector >03/25/14 14:20:30 Getting monitoring info for pid 22893 >03/25/14 14:20:31 Getting monitoring info for pid 22893 >03/25/14 14:20:32 Getting monitoring info for pid 22893 >03/25/14 14:20:33 Getting monitoring info for pid 22893 >03/25/14 14:20:34 Getting monitoring info for pid 22893 >03/25/14 14:20:35 Getting monitoring info for pid 22893 >03/25/14 14:20:36 Getting monitoring info for pid 22893 >03/25/14 14:20:37 Getting monitoring info for pid 22893 >03/25/14 14:20:38 Getting monitoring info for pid 22893 >03/25/14 14:20:39 Getting monitoring info for pid 22893 >03/25/14 14:20:40 Getting monitoring info for pid 22893 >03/25/14 14:20:41 ---------- Started Negotiation Cycle ---------- >03/25/14 14:20:41 Phase 1: Obtaining ads from collector ... >03/25/14 14:20:41 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:20:41 Trying to query collector <IP:9618> >03/25/14 14:20:41 Sorting 32 ads ... >03/25/14 14:20:41 Getting startd private ads ... >03/25/14 14:20:41 Trying to query collector <IP:9618> >03/25/14 14:20:41 Got ads: 32 public and 30 private >03/25/14 14:20:41 Public ads include 1 submitter, 30 startd >03/25/14 14:20:41 Phase 2: Performing accounting ... >03/25/14 14:20:41 Entering compute_significant_attrs() >03/25/14 14:20:41 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:20:41 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:20:41 CustomerName=Customer.<none> , Old Priority=0.913 , New Priority=0.918 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=53325.000 (unweighted 53325.000), BeginUsageTime=1395751882 >03/25/14 14:20:41 CustomerName=Customer.test@<hostname> , Old Priority=0.913 , New Priority=0.918 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:20:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=53325.000 (unweighted 53325.000), BeginUsageTime=1395751882 >03/25/14 14:20:41 (Accountant) Checking Matches >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:20:41 Match already existed! >03/25/14 14:20:41 Previous Limits -- >03/25/14 14:20:41 Limit: test = 3.000000 >03/25/14 14:20:41 Limit: small.test = 2.000000 >03/25/14 14:20:41 Limit: medium.test = 5.000000 >03/25/14 14:20:41 Limit: undef.test = 1.000000 >03/25/14 14:20:41 Limit: undef = 1.000000 >03/25/14 14:20:41 Limit: large.test = 13.000000 >03/25/14 14:20:41 Limit: medium.undef = 5.000000 >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(medium.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(medium.undef) >03/25/14 14:20:41 IncrementLimit(small.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(medium.undef) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(medium.undef) >03/25/14 14:20:41 IncrementLimit(medium.undef) >03/25/14 14:20:41 IncrementLimit(medium.undef) >03/25/14 14:20:41 IncrementLimit(small.test) >03/25/14 14:20:41 IncrementLimit(test) >03/25/14 14:20:41 IncrementLimit(medium.test) >03/25/14 14:20:41 IncrementLimit(test) >03/25/14 14:20:41 IncrementLimit(medium.test) >03/25/14 14:20:41 IncrementLimit(test) >03/25/14 14:20:41 IncrementLimit(medium.test) >03/25/14 14:20:41 IncrementLimit(undef.test) >03/25/14 14:20:41 IncrementLimit(medium.test) >03/25/14 14:20:41 IncrementLimit(undef) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 IncrementLimit(large.test) >03/25/14 14:20:41 Current Limits -- >03/25/14 14:20:41 Limit: test = 3.000000 >03/25/14 14:20:41 Limit: small.test = 2.000000 >03/25/14 14:20:41 Limit: medium.test = 5.000000 >03/25/14 14:20:41 Limit: undef.test = 1.000000 >03/25/14 14:20:41 Limit: undef = 1.000000 >03/25/14 14:20:41 Limit: large.test = 13.000000 >03/25/14 14:20:41 Limit: medium.undef = 5.000000 >03/25/14 14:20:41 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:20:41 Phase 4.1: Negotiating with schedds ... >03/25/14 14:20:41 numSlots = 30 >03/25/14 14:20:41 slotWeightTotal = 30.000000 >03/25/14 14:20:41 pieLeft = 0.000 >03/25/14 14:20:41 NormalFactor = 1.000000 >03/25/14 14:20:41 MaxPrioValue = 0.917697 >03/25/14 14:20:41 NumSubmitterAds = 1 >03/25/14 14:20:41 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:20:41 0 seconds so far >03/25/14 14:20:41 Calculating submitter limit with the following parameters >03/25/14 14:20:41 SubmitterPrio = 0.917697 >03/25/14 14:20:41 SubmitterPrioFactor = 1.000000 >03/25/14 14:20:41 submitterShare = 1.000000 >03/25/14 14:20:41 submitterAbsShare = 1.000000 >03/25/14 14:20:41 submitterLimit = 0.000000 >03/25/14 14:20:41 submitterUsage = 30.000000 >03/25/14 14:20:41 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:20:41 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00011: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: large.test is 13.000000 >03/25/14 14:20:41 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:20:41 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00025: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:20:41 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:41 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00042: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: small.test is 2.000000 >03/25/14 14:20:41 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:20:41 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00063: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: test is 3.000000 >03/25/14 14:20:41 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:20:41 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00081: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:20:41 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:41 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00101: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: undef is 1.000000 >03/25/14 14:20:41 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:20:41 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:20:41 Request 00001.00125: >03/25/14 14:20:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:20:41 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:20:41 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:20:41 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:20:41 Sending SEND_JOB_INFO/eom >03/25/14 14:20:41 Getting reply from schedd ... >03/25/14 14:20:41 Got NO_MORE_JOBS; done negotiating >03/25/14 14:20:41 This submitter hit its submitterLimit. >03/25/14 14:20:41 resources used scheddUsed= 30.000000 >03/25/14 14:20:41 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:20:41 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:20:41 Getting monitoring info for pid 22893 >03/25/14 14:20:42 Getting monitoring info for pid 22893 >03/25/14 14:20:43 Getting monitoring info for pid 22893 >03/25/14 14:20:44 Getting monitoring info for pid 22893 >03/25/14 14:20:45 Getting monitoring info for pid 22893 >03/25/14 14:20:46 Getting monitoring info for pid 22893 >03/25/14 14:20:47 Getting monitoring info for pid 22893 >03/25/14 14:20:48 Getting monitoring info for pid 22893 >03/25/14 14:20:49 Getting monitoring info for pid 22893 >03/25/14 14:20:50 Getting monitoring info for pid 22893 >03/25/14 14:20:51 Getting monitoring info for pid 22893 >03/25/14 14:20:52 Getting monitoring info for pid 22893 >03/25/14 14:20:53 Getting monitoring info for pid 22893 >03/25/14 14:20:54 Getting monitoring info for pid 22893 >03/25/14 14:20:55 Getting monitoring info for pid 22893 >03/25/14 14:20:56 Getting monitoring info for pid 22893 >03/25/14 14:20:57 Getting monitoring info for pid 22893 >03/25/14 14:20:58 Getting monitoring info for pid 22893 >03/25/14 14:20:59 Getting monitoring info for pid 22893 >03/25/14 14:21:00 Getting monitoring info for pid 22893 >03/25/14 14:21:01 Getting state information from the accountant >03/25/14 14:21:01 Reporting State >03/25/14 14:21:01 ---------- Started Negotiation Cycle ---------- >03/25/14 14:21:01 Phase 1: Obtaining ads from collector ... >03/25/14 14:21:01 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:21:01 Trying to query collector <IP:9618> >03/25/14 14:21:01 Sorting 32 ads ... >03/25/14 14:21:01 Getting startd private ads ... >03/25/14 14:21:01 Trying to query collector <IP:9618> >03/25/14 14:21:01 Got ads: 32 public and 30 private >03/25/14 14:21:01 Public ads include 1 submitter, 30 startd >03/25/14 14:21:01 Phase 2: Performing accounting ... >03/25/14 14:21:01 Entering compute_significant_attrs() >03/25/14 14:21:01 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:21:01 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:21:01 CustomerName=Customer.<none> , Old Priority=0.918 , New Priority=0.922 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=53925.000 (unweighted 53925.000), BeginUsageTime=1395751882 >03/25/14 14:21:01 CustomerName=Customer.test@<hostname> , Old Priority=0.918 , New Priority=0.922 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=53925.000 (unweighted 53925.000), BeginUsageTime=1395751882 >03/25/14 14:21:01 (Accountant) Checking Matches >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:21:01 Match already existed! >03/25/14 14:21:01 Previous Limits -- >03/25/14 14:21:01 Limit: test = 3.000000 >03/25/14 14:21:01 Limit: small.test = 2.000000 >03/25/14 14:21:01 Limit: medium.test = 5.000000 >03/25/14 14:21:01 Limit: undef.test = 1.000000 >03/25/14 14:21:01 Limit: undef = 1.000000 >03/25/14 14:21:01 Limit: large.test = 13.000000 >03/25/14 14:21:01 Limit: medium.undef = 5.000000 >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(medium.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(medium.undef) >03/25/14 14:21:01 IncrementLimit(small.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(medium.undef) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(medium.undef) >03/25/14 14:21:01 IncrementLimit(medium.undef) >03/25/14 14:21:01 IncrementLimit(medium.undef) >03/25/14 14:21:01 IncrementLimit(small.test) >03/25/14 14:21:01 IncrementLimit(test) >03/25/14 14:21:01 IncrementLimit(medium.test) >03/25/14 14:21:01 IncrementLimit(test) >03/25/14 14:21:01 IncrementLimit(medium.test) >03/25/14 14:21:01 IncrementLimit(test) >03/25/14 14:21:01 IncrementLimit(medium.test) >03/25/14 14:21:01 IncrementLimit(undef.test) >03/25/14 14:21:01 IncrementLimit(medium.test) >03/25/14 14:21:01 IncrementLimit(undef) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 IncrementLimit(large.test) >03/25/14 14:21:01 Current Limits -- >03/25/14 14:21:01 Limit: test = 3.000000 >03/25/14 14:21:01 Limit: small.test = 2.000000 >03/25/14 14:21:01 Limit: medium.test = 5.000000 >03/25/14 14:21:01 Limit: undef.test = 1.000000 >03/25/14 14:21:01 Limit: undef = 1.000000 >03/25/14 14:21:01 Limit: large.test = 13.000000 >03/25/14 14:21:01 Limit: medium.undef = 5.000000 >03/25/14 14:21:01 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:21:01 Phase 4.1: Negotiating with schedds ... >03/25/14 14:21:01 numSlots = 30 >03/25/14 14:21:01 slotWeightTotal = 30.000000 >03/25/14 14:21:01 pieLeft = 0.000 >03/25/14 14:21:01 NormalFactor = 1.000000 >03/25/14 14:21:01 MaxPrioValue = 0.922363 >03/25/14 14:21:01 NumSubmitterAds = 1 >03/25/14 14:21:01 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:21:01 0 seconds so far >03/25/14 14:21:01 Calculating submitter limit with the following parameters >03/25/14 14:21:01 SubmitterPrio = 0.922363 >03/25/14 14:21:01 SubmitterPrioFactor = 1.000000 >03/25/14 14:21:01 submitterShare = 1.000000 >03/25/14 14:21:01 submitterAbsShare = 1.000000 >03/25/14 14:21:01 submitterLimit = 0.000000 >03/25/14 14:21:01 submitterUsage = 30.000000 >03/25/14 14:21:01 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:21:01 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00011: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: large.test is 13.000000 >03/25/14 14:21:01 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:21:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00025: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:21:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00042: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: small.test is 2.000000 >03/25/14 14:21:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:21:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00063: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: test is 3.000000 >03/25/14 14:21:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:21:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00081: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:21:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00101: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: undef is 1.000000 >03/25/14 14:21:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:01 Request 00001.00125: >03/25/14 14:21:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:21:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:21:01 Sending SEND_JOB_INFO/eom >03/25/14 14:21:01 Getting reply from schedd ... >03/25/14 14:21:01 Got NO_MORE_JOBS; done negotiating >03/25/14 14:21:01 This submitter hit its submitterLimit. >03/25/14 14:21:01 resources used scheddUsed= 30.000000 >03/25/14 14:21:01 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:21:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:21:01 Getting monitoring info for pid 22893 >03/25/14 14:21:02 Getting monitoring info for pid 22893 >03/25/14 14:21:03 Getting monitoring info for pid 22893 >03/25/14 14:21:04 Getting monitoring info for pid 22893 >03/25/14 14:21:05 Getting monitoring info for pid 22893 >03/25/14 14:21:06 Getting monitoring info for pid 22893 >03/25/14 14:21:07 Getting monitoring info for pid 22893 >03/25/14 14:21:08 Getting monitoring info for pid 22893 >03/25/14 14:21:09 Getting monitoring info for pid 22893 >03/25/14 14:21:10 Getting monitoring info for pid 22893 >03/25/14 14:21:11 Getting monitoring info for pid 22893 >03/25/14 14:21:12 Getting monitoring info for pid 22893 >03/25/14 14:21:13 Getting monitoring info for pid 22893 >03/25/14 14:21:14 Getting monitoring info for pid 22893 >03/25/14 14:21:15 Getting monitoring info for pid 22893 >03/25/14 14:21:16 Getting monitoring info for pid 22893 >03/25/14 14:21:17 Getting monitoring info for pid 22893 >03/25/14 14:21:18 Getting monitoring info for pid 22893 >03/25/14 14:21:19 Getting monitoring info for pid 22893 >03/25/14 14:21:20 Getting monitoring info for pid 22893 >03/25/14 14:21:21 ---------- Started Negotiation Cycle ---------- >03/25/14 14:21:21 Phase 1: Obtaining ads from collector ... >03/25/14 14:21:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:21:21 Trying to query collector <IP:9618> >03/25/14 14:21:21 Sorting 32 ads ... >03/25/14 14:21:21 Getting startd private ads ... >03/25/14 14:21:21 Trying to query collector <IP:9618> >03/25/14 14:21:21 Got ads: 32 public and 30 private >03/25/14 14:21:21 Public ads include 1 submitter, 30 startd >03/25/14 14:21:21 Phase 2: Performing accounting ... >03/25/14 14:21:21 Entering compute_significant_attrs() >03/25/14 14:21:21 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:21:21 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:21:21 CustomerName=Customer.<none> , Old Priority=0.922 , New Priority=0.927 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=54525.000 (unweighted 54525.000), BeginUsageTime=1395751882 >03/25/14 14:21:21 CustomerName=Customer.test@<hostname> , Old Priority=0.922 , New Priority=0.927 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=54525.000 (unweighted 54525.000), BeginUsageTime=1395751882 >03/25/14 14:21:21 (Accountant) Checking Matches >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:21:21 Match already existed! >03/25/14 14:21:21 Previous Limits -- >03/25/14 14:21:21 Limit: test = 3.000000 >03/25/14 14:21:21 Limit: small.test = 2.000000 >03/25/14 14:21:21 Limit: medium.test = 5.000000 >03/25/14 14:21:21 Limit: undef.test = 1.000000 >03/25/14 14:21:21 Limit: undef = 1.000000 >03/25/14 14:21:21 Limit: large.test = 13.000000 >03/25/14 14:21:21 Limit: medium.undef = 5.000000 >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(medium.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(medium.undef) >03/25/14 14:21:21 IncrementLimit(small.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(medium.undef) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(medium.undef) >03/25/14 14:21:21 IncrementLimit(medium.undef) >03/25/14 14:21:21 IncrementLimit(medium.undef) >03/25/14 14:21:21 IncrementLimit(small.test) >03/25/14 14:21:21 IncrementLimit(test) >03/25/14 14:21:21 IncrementLimit(medium.test) >03/25/14 14:21:21 IncrementLimit(test) >03/25/14 14:21:21 IncrementLimit(medium.test) >03/25/14 14:21:21 IncrementLimit(test) >03/25/14 14:21:21 IncrementLimit(medium.test) >03/25/14 14:21:21 IncrementLimit(undef.test) >03/25/14 14:21:21 IncrementLimit(medium.test) >03/25/14 14:21:21 IncrementLimit(undef) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 IncrementLimit(large.test) >03/25/14 14:21:21 Current Limits -- >03/25/14 14:21:21 Limit: test = 3.000000 >03/25/14 14:21:21 Limit: small.test = 2.000000 >03/25/14 14:21:21 Limit: medium.test = 5.000000 >03/25/14 14:21:21 Limit: undef.test = 1.000000 >03/25/14 14:21:21 Limit: undef = 1.000000 >03/25/14 14:21:21 Limit: large.test = 13.000000 >03/25/14 14:21:21 Limit: medium.undef = 5.000000 >03/25/14 14:21:21 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:21:21 Phase 4.1: Negotiating with schedds ... >03/25/14 14:21:21 numSlots = 30 >03/25/14 14:21:21 slotWeightTotal = 30.000000 >03/25/14 14:21:21 pieLeft = 0.000 >03/25/14 14:21:21 NormalFactor = 1.000000 >03/25/14 14:21:21 MaxPrioValue = 0.927029 >03/25/14 14:21:21 NumSubmitterAds = 1 >03/25/14 14:21:21 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:21:21 0 seconds so far >03/25/14 14:21:21 Calculating submitter limit with the following parameters >03/25/14 14:21:21 SubmitterPrio = 0.927029 >03/25/14 14:21:21 SubmitterPrioFactor = 1.000000 >03/25/14 14:21:21 submitterShare = 1.000000 >03/25/14 14:21:21 submitterAbsShare = 1.000000 >03/25/14 14:21:21 submitterLimit = 0.000000 >03/25/14 14:21:21 submitterUsage = 30.000000 >03/25/14 14:21:21 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:21:21 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00011: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: large.test is 13.000000 >03/25/14 14:21:21 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:21:21 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00025: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:21:21 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:21 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00042: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: small.test is 2.000000 >03/25/14 14:21:21 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:21:21 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00063: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: test is 3.000000 >03/25/14 14:21:21 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:21:21 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00081: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:21:21 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:21 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00101: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: undef is 1.000000 >03/25/14 14:21:21 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:21 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:21 Request 00001.00125: >03/25/14 14:21:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:21 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:21:21 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:21 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:21:21 Sending SEND_JOB_INFO/eom >03/25/14 14:21:21 Getting reply from schedd ... >03/25/14 14:21:21 Got NO_MORE_JOBS; done negotiating >03/25/14 14:21:21 This submitter hit its submitterLimit. >03/25/14 14:21:21 resources used scheddUsed= 30.000000 >03/25/14 14:21:21 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:21:21 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:21:21 Getting monitoring info for pid 22893 >03/25/14 14:21:22 Getting monitoring info for pid 22893 >03/25/14 14:21:23 Getting monitoring info for pid 22893 >03/25/14 14:21:24 Getting monitoring info for pid 22893 >03/25/14 14:21:25 Getting monitoring info for pid 22893 >03/25/14 14:21:26 Getting monitoring info for pid 22893 >03/25/14 14:21:27 Getting monitoring info for pid 22893 >03/25/14 14:21:28 Getting monitoring info for pid 22893 >03/25/14 14:21:29 Getting monitoring info for pid 22893 >03/25/14 14:21:30 Getting monitoring info for pid 22893 >03/25/14 14:21:31 Getting monitoring info for pid 22893 >03/25/14 14:21:32 Getting monitoring info for pid 22893 >03/25/14 14:21:33 Getting monitoring info for pid 22893 >03/25/14 14:21:34 Getting monitoring info for pid 22893 >03/25/14 14:21:35 Getting monitoring info for pid 22893 >03/25/14 14:21:36 Getting monitoring info for pid 22893 >03/25/14 14:21:37 Getting monitoring info for pid 22893 >03/25/14 14:21:38 Getting monitoring info for pid 22893 >03/25/14 14:21:39 Getting monitoring info for pid 22893 >03/25/14 14:21:40 Getting monitoring info for pid 22893 >03/25/14 14:21:41 ---------- Started Negotiation Cycle ---------- >03/25/14 14:21:41 Phase 1: Obtaining ads from collector ... >03/25/14 14:21:41 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:21:41 Trying to query collector <IP:9618> >03/25/14 14:21:41 Sorting 32 ads ... >03/25/14 14:21:41 Getting startd private ads ... >03/25/14 14:21:41 Trying to query collector <IP:9618> >03/25/14 14:21:41 Got ads: 32 public and 30 private >03/25/14 14:21:41 Public ads include 1 submitter, 30 startd >03/25/14 14:21:41 Phase 2: Performing accounting ... >03/25/14 14:21:41 Entering compute_significant_attrs() >03/25/14 14:21:41 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:21:41 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:21:41 CustomerName=Customer.<none> , Old Priority=0.927 , New Priority=0.932 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=55125.000 (unweighted 55125.000), BeginUsageTime=1395751882 >03/25/14 14:21:41 CustomerName=Customer.test@<hostname> , Old Priority=0.927 , New Priority=0.932 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:21:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=55125.000 (unweighted 55125.000), BeginUsageTime=1395751882 >03/25/14 14:21:41 (Accountant) Checking Matches >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:21:41 Match already existed! >03/25/14 14:21:41 Previous Limits -- >03/25/14 14:21:41 Limit: test = 3.000000 >03/25/14 14:21:41 Limit: small.test = 2.000000 >03/25/14 14:21:41 Limit: medium.test = 5.000000 >03/25/14 14:21:41 Limit: undef.test = 1.000000 >03/25/14 14:21:41 Limit: undef = 1.000000 >03/25/14 14:21:41 Limit: large.test = 13.000000 >03/25/14 14:21:41 Limit: medium.undef = 5.000000 >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(medium.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(medium.undef) >03/25/14 14:21:41 IncrementLimit(small.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(medium.undef) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(medium.undef) >03/25/14 14:21:41 IncrementLimit(medium.undef) >03/25/14 14:21:41 IncrementLimit(medium.undef) >03/25/14 14:21:41 IncrementLimit(small.test) >03/25/14 14:21:41 IncrementLimit(test) >03/25/14 14:21:41 IncrementLimit(medium.test) >03/25/14 14:21:41 IncrementLimit(test) >03/25/14 14:21:41 IncrementLimit(medium.test) >03/25/14 14:21:41 IncrementLimit(test) >03/25/14 14:21:41 IncrementLimit(medium.test) >03/25/14 14:21:41 IncrementLimit(undef.test) >03/25/14 14:21:41 IncrementLimit(medium.test) >03/25/14 14:21:41 IncrementLimit(undef) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 IncrementLimit(large.test) >03/25/14 14:21:41 Current Limits -- >03/25/14 14:21:41 Limit: test = 3.000000 >03/25/14 14:21:41 Limit: small.test = 2.000000 >03/25/14 14:21:41 Limit: medium.test = 5.000000 >03/25/14 14:21:41 Limit: undef.test = 1.000000 >03/25/14 14:21:41 Limit: undef = 1.000000 >03/25/14 14:21:41 Limit: large.test = 13.000000 >03/25/14 14:21:41 Limit: medium.undef = 5.000000 >03/25/14 14:21:41 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:21:41 Phase 4.1: Negotiating with schedds ... >03/25/14 14:21:41 numSlots = 30 >03/25/14 14:21:41 slotWeightTotal = 30.000000 >03/25/14 14:21:41 pieLeft = 0.000 >03/25/14 14:21:41 NormalFactor = 1.000000 >03/25/14 14:21:41 MaxPrioValue = 0.931694 >03/25/14 14:21:41 NumSubmitterAds = 1 >03/25/14 14:21:41 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:21:41 0 seconds so far >03/25/14 14:21:41 Calculating submitter limit with the following parameters >03/25/14 14:21:41 SubmitterPrio = 0.931694 >03/25/14 14:21:41 SubmitterPrioFactor = 1.000000 >03/25/14 14:21:41 submitterShare = 1.000000 >03/25/14 14:21:41 submitterAbsShare = 1.000000 >03/25/14 14:21:41 submitterLimit = 0.000000 >03/25/14 14:21:41 submitterUsage = 30.000000 >03/25/14 14:21:41 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:21:41 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00011: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: large.test is 13.000000 >03/25/14 14:21:41 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:21:41 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00025: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:21:41 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:41 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00042: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: small.test is 2.000000 >03/25/14 14:21:41 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:21:41 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00063: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: test is 3.000000 >03/25/14 14:21:41 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:21:41 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00081: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:21:41 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:41 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00101: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: undef is 1.000000 >03/25/14 14:21:41 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:21:41 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:21:41 Request 00001.00125: >03/25/14 14:21:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:21:41 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:21:41 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:21:41 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:21:41 Sending SEND_JOB_INFO/eom >03/25/14 14:21:41 Getting reply from schedd ... >03/25/14 14:21:41 Got NO_MORE_JOBS; done negotiating >03/25/14 14:21:41 This submitter hit its submitterLimit. >03/25/14 14:21:41 resources used scheddUsed= 30.000000 >03/25/14 14:21:41 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:21:41 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:21:41 Getting monitoring info for pid 22893 >03/25/14 14:21:42 Getting monitoring info for pid 22893 >03/25/14 14:21:43 Getting monitoring info for pid 22893 >03/25/14 14:21:44 Getting monitoring info for pid 22893 >03/25/14 14:21:45 Getting monitoring info for pid 22893 >03/25/14 14:21:46 Getting monitoring info for pid 22893 >03/25/14 14:21:48 Getting monitoring info for pid 22893 >03/25/14 14:21:49 Getting monitoring info for pid 22893 >03/25/14 14:21:50 Getting monitoring info for pid 22893 >03/25/14 14:21:51 Getting monitoring info for pid 22893 >03/25/14 14:21:52 Getting monitoring info for pid 22893 >03/25/14 14:21:53 Getting monitoring info for pid 22893 >03/25/14 14:21:54 Getting monitoring info for pid 22893 >03/25/14 14:21:55 Getting monitoring info for pid 22893 >03/25/14 14:21:56 Getting monitoring info for pid 22893 >03/25/14 14:21:57 Getting monitoring info for pid 22893 >03/25/14 14:21:58 Getting monitoring info for pid 22893 >03/25/14 14:21:59 Getting monitoring info for pid 22893 >03/25/14 14:22:00 Getting monitoring info for pid 22893 >03/25/14 14:22:01 ---------- Started Negotiation Cycle ---------- >03/25/14 14:22:01 Phase 1: Obtaining ads from collector ... >03/25/14 14:22:01 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:22:01 Trying to query collector <IP:9618> >03/25/14 14:22:01 Sorting 32 ads ... >03/25/14 14:22:01 Getting startd private ads ... >03/25/14 14:22:01 Trying to query collector <IP:9618> >03/25/14 14:22:01 Got ads: 32 public and 30 private >03/25/14 14:22:01 Public ads include 1 submitter, 30 startd >03/25/14 14:22:01 Phase 2: Performing accounting ... >03/25/14 14:22:01 Entering compute_significant_attrs() >03/25/14 14:22:01 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:22:01 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:22:01 CustomerName=Customer.<none> , Old Priority=0.932 , New Priority=0.936 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=55725.000 (unweighted 55725.000), BeginUsageTime=1395751882 >03/25/14 14:22:01 CustomerName=Customer.test@<hostname> , Old Priority=0.932 , New Priority=0.936 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=55725.000 (unweighted 55725.000), BeginUsageTime=1395751882 >03/25/14 14:22:01 (Accountant) Checking Matches >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:22:01 Match already existed! >03/25/14 14:22:01 Previous Limits -- >03/25/14 14:22:01 Limit: test = 3.000000 >03/25/14 14:22:01 Limit: small.test = 2.000000 >03/25/14 14:22:01 Limit: medium.test = 5.000000 >03/25/14 14:22:01 Limit: undef.test = 1.000000 >03/25/14 14:22:01 Limit: undef = 1.000000 >03/25/14 14:22:01 Limit: large.test = 13.000000 >03/25/14 14:22:01 Limit: medium.undef = 5.000000 >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(medium.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(medium.undef) >03/25/14 14:22:01 IncrementLimit(small.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(medium.undef) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(medium.undef) >03/25/14 14:22:01 IncrementLimit(medium.undef) >03/25/14 14:22:01 IncrementLimit(medium.undef) >03/25/14 14:22:01 IncrementLimit(small.test) >03/25/14 14:22:01 IncrementLimit(test) >03/25/14 14:22:01 IncrementLimit(medium.test) >03/25/14 14:22:01 IncrementLimit(test) >03/25/14 14:22:01 IncrementLimit(medium.test) >03/25/14 14:22:01 IncrementLimit(test) >03/25/14 14:22:01 IncrementLimit(medium.test) >03/25/14 14:22:01 IncrementLimit(undef.test) >03/25/14 14:22:01 IncrementLimit(medium.test) >03/25/14 14:22:01 IncrementLimit(undef) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 IncrementLimit(large.test) >03/25/14 14:22:01 Current Limits -- >03/25/14 14:22:01 Limit: test = 3.000000 >03/25/14 14:22:01 Limit: small.test = 2.000000 >03/25/14 14:22:01 Limit: medium.test = 5.000000 >03/25/14 14:22:01 Limit: undef.test = 1.000000 >03/25/14 14:22:01 Limit: undef = 1.000000 >03/25/14 14:22:01 Limit: large.test = 13.000000 >03/25/14 14:22:01 Limit: medium.undef = 5.000000 >03/25/14 14:22:01 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:22:01 Phase 4.1: Negotiating with schedds ... >03/25/14 14:22:01 numSlots = 30 >03/25/14 14:22:01 slotWeightTotal = 30.000000 >03/25/14 14:22:01 pieLeft = 0.000 >03/25/14 14:22:01 NormalFactor = 1.000000 >03/25/14 14:22:01 MaxPrioValue = 0.936358 >03/25/14 14:22:01 NumSubmitterAds = 1 >03/25/14 14:22:01 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:22:01 0 seconds so far >03/25/14 14:22:01 Calculating submitter limit with the following parameters >03/25/14 14:22:01 SubmitterPrio = 0.936358 >03/25/14 14:22:01 SubmitterPrioFactor = 1.000000 >03/25/14 14:22:01 submitterShare = 1.000000 >03/25/14 14:22:01 submitterAbsShare = 1.000000 >03/25/14 14:22:01 submitterLimit = 0.000000 >03/25/14 14:22:01 submitterUsage = 30.000000 >03/25/14 14:22:01 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:22:01 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00011: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: large.test is 13.000000 >03/25/14 14:22:01 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:22:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00025: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:22:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00042: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: small.test is 2.000000 >03/25/14 14:22:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:22:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00063: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: test is 3.000000 >03/25/14 14:22:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:22:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00081: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:22:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00101: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: undef is 1.000000 >03/25/14 14:22:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:01 Request 00001.00125: >03/25/14 14:22:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:22:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:22:01 Sending SEND_JOB_INFO/eom >03/25/14 14:22:01 Getting reply from schedd ... >03/25/14 14:22:01 Got NO_MORE_JOBS; done negotiating >03/25/14 14:22:01 This submitter hit its submitterLimit. >03/25/14 14:22:01 resources used scheddUsed= 30.000000 >03/25/14 14:22:01 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:22:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:22:01 Getting monitoring info for pid 22893 >03/25/14 14:22:02 Getting monitoring info for pid 22893 >03/25/14 14:22:03 Getting monitoring info for pid 22893 >03/25/14 14:22:04 Getting monitoring info for pid 22893 >03/25/14 14:22:05 Getting monitoring info for pid 22893 >03/25/14 14:22:06 Getting monitoring info for pid 22893 >03/25/14 14:22:07 Getting monitoring info for pid 22893 >03/25/14 14:22:08 Getting monitoring info for pid 22893 >03/25/14 14:22:09 Getting monitoring info for pid 22893 >03/25/14 14:22:10 Getting monitoring info for pid 22893 >03/25/14 14:22:11 Getting monitoring info for pid 22893 >03/25/14 14:22:12 Getting monitoring info for pid 22893 >03/25/14 14:22:13 Getting monitoring info for pid 22893 >03/25/14 14:22:14 Getting monitoring info for pid 22893 >03/25/14 14:22:15 Getting monitoring info for pid 22893 >03/25/14 14:22:16 Getting monitoring info for pid 22893 >03/25/14 14:22:17 Getting monitoring info for pid 22893 >03/25/14 14:22:18 Getting monitoring info for pid 22893 >03/25/14 14:22:19 Getting monitoring info for pid 22893 >03/25/14 14:22:20 Getting monitoring info for pid 22893 >03/25/14 14:22:21 ---------- Started Negotiation Cycle ---------- >03/25/14 14:22:21 Phase 1: Obtaining ads from collector ... >03/25/14 14:22:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:22:21 Trying to query collector <IP:9618> >03/25/14 14:22:21 Sorting 32 ads ... >03/25/14 14:22:21 Getting startd private ads ... >03/25/14 14:22:21 Trying to query collector <IP:9618> >03/25/14 14:22:21 Got ads: 32 public and 30 private >03/25/14 14:22:21 Public ads include 1 submitter, 30 startd >03/25/14 14:22:21 Phase 2: Performing accounting ... >03/25/14 14:22:21 Entering compute_significant_attrs() >03/25/14 14:22:21 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:22:21 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:22:21 CustomerName=Customer.<none> , Old Priority=0.936 , New Priority=0.941 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=56325.000 (unweighted 56325.000), BeginUsageTime=1395751882 >03/25/14 14:22:21 CustomerName=Customer.test@<hostname> , Old Priority=0.936 , New Priority=0.941 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=56325.000 (unweighted 56325.000), BeginUsageTime=1395751882 >03/25/14 14:22:21 (Accountant) Checking Matches >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:22:21 Match already existed! >03/25/14 14:22:21 Previous Limits -- >03/25/14 14:22:21 Limit: test = 3.000000 >03/25/14 14:22:21 Limit: small.test = 2.000000 >03/25/14 14:22:21 Limit: medium.test = 5.000000 >03/25/14 14:22:21 Limit: undef.test = 1.000000 >03/25/14 14:22:21 Limit: undef = 1.000000 >03/25/14 14:22:21 Limit: large.test = 13.000000 >03/25/14 14:22:21 Limit: medium.undef = 5.000000 >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(medium.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(medium.undef) >03/25/14 14:22:21 IncrementLimit(small.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(medium.undef) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(medium.undef) >03/25/14 14:22:21 IncrementLimit(medium.undef) >03/25/14 14:22:21 IncrementLimit(medium.undef) >03/25/14 14:22:21 IncrementLimit(small.test) >03/25/14 14:22:21 IncrementLimit(test) >03/25/14 14:22:21 IncrementLimit(medium.test) >03/25/14 14:22:21 IncrementLimit(test) >03/25/14 14:22:21 IncrementLimit(medium.test) >03/25/14 14:22:21 IncrementLimit(test) >03/25/14 14:22:21 IncrementLimit(medium.test) >03/25/14 14:22:21 IncrementLimit(undef.test) >03/25/14 14:22:21 IncrementLimit(medium.test) >03/25/14 14:22:21 IncrementLimit(undef) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 IncrementLimit(large.test) >03/25/14 14:22:21 Current Limits -- >03/25/14 14:22:21 Limit: test = 3.000000 >03/25/14 14:22:21 Limit: small.test = 2.000000 >03/25/14 14:22:21 Limit: medium.test = 5.000000 >03/25/14 14:22:21 Limit: undef.test = 1.000000 >03/25/14 14:22:21 Limit: undef = 1.000000 >03/25/14 14:22:21 Limit: large.test = 13.000000 >03/25/14 14:22:21 Limit: medium.undef = 5.000000 >03/25/14 14:22:21 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:22:21 Phase 4.1: Negotiating with schedds ... >03/25/14 14:22:21 numSlots = 30 >03/25/14 14:22:21 slotWeightTotal = 30.000000 >03/25/14 14:22:21 pieLeft = 0.000 >03/25/14 14:22:21 NormalFactor = 1.000000 >03/25/14 14:22:21 MaxPrioValue = 0.941021 >03/25/14 14:22:21 NumSubmitterAds = 1 >03/25/14 14:22:21 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:22:21 0 seconds so far >03/25/14 14:22:21 Calculating submitter limit with the following parameters >03/25/14 14:22:21 SubmitterPrio = 0.941021 >03/25/14 14:22:21 SubmitterPrioFactor = 1.000000 >03/25/14 14:22:21 submitterShare = 1.000000 >03/25/14 14:22:21 submitterAbsShare = 1.000000 >03/25/14 14:22:21 submitterLimit = 0.000000 >03/25/14 14:22:21 submitterUsage = 30.000000 >03/25/14 14:22:21 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:22:21 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00011: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: large.test is 13.000000 >03/25/14 14:22:21 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:22:21 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00025: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:22:21 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:21 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00042: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: small.test is 2.000000 >03/25/14 14:22:21 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:22:21 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00063: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: test is 3.000000 >03/25/14 14:22:21 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:22:21 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00081: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:22:21 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:21 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00101: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: undef is 1.000000 >03/25/14 14:22:21 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:21 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:21 Request 00001.00125: >03/25/14 14:22:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:21 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:22:21 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:21 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:22:21 Sending SEND_JOB_INFO/eom >03/25/14 14:22:21 Getting reply from schedd ... >03/25/14 14:22:21 Got NO_MORE_JOBS; done negotiating >03/25/14 14:22:21 This submitter hit its submitterLimit. >03/25/14 14:22:21 resources used scheddUsed= 30.000000 >03/25/14 14:22:21 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:22:21 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:22:21 Getting monitoring info for pid 22893 >03/25/14 14:22:22 Getting monitoring info for pid 22893 >03/25/14 14:22:23 Getting monitoring info for pid 22893 >03/25/14 14:22:24 Getting monitoring info for pid 22893 >03/25/14 14:22:25 Getting monitoring info for pid 22893 >03/25/14 14:22:26 Getting monitoring info for pid 22893 >03/25/14 14:22:27 Getting monitoring info for pid 22893 >03/25/14 14:22:28 Getting monitoring info for pid 22893 >03/25/14 14:22:29 Getting monitoring info for pid 22893 >03/25/14 14:22:30 Getting monitoring info for pid 22893 >03/25/14 14:22:31 Getting monitoring info for pid 22893 >03/25/14 14:22:32 Getting monitoring info for pid 22893 >03/25/14 14:22:33 Getting monitoring info for pid 22893 >03/25/14 14:22:34 Getting monitoring info for pid 22893 >03/25/14 14:22:35 Getting monitoring info for pid 22893 >03/25/14 14:22:36 Getting monitoring info for pid 22893 >03/25/14 14:22:37 Getting monitoring info for pid 22893 >03/25/14 14:22:38 Getting monitoring info for pid 22893 >03/25/14 14:22:39 Getting monitoring info for pid 22893 >03/25/14 14:22:40 Getting monitoring info for pid 22893 >03/25/14 14:22:41 ---------- Started Negotiation Cycle ---------- >03/25/14 14:22:41 Phase 1: Obtaining ads from collector ... >03/25/14 14:22:41 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:22:41 Trying to query collector <IP:9618> >03/25/14 14:22:41 Sorting 32 ads ... >03/25/14 14:22:41 Getting startd private ads ... >03/25/14 14:22:41 Trying to query collector <IP:9618> >03/25/14 14:22:41 Got ads: 32 public and 30 private >03/25/14 14:22:41 Public ads include 1 submitter, 30 startd >03/25/14 14:22:41 Phase 2: Performing accounting ... >03/25/14 14:22:41 Entering compute_significant_attrs() >03/25/14 14:22:41 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:22:41 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:22:41 CustomerName=Customer.<none> , Old Priority=0.941 , New Priority=0.946 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=56925.000 (unweighted 56925.000), BeginUsageTime=1395751882 >03/25/14 14:22:41 CustomerName=Customer.test@<hostname> , Old Priority=0.941 , New Priority=0.946 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:22:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=56925.000 (unweighted 56925.000), BeginUsageTime=1395751882 >03/25/14 14:22:41 (Accountant) Checking Matches >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:22:41 Match already existed! >03/25/14 14:22:41 Previous Limits -- >03/25/14 14:22:41 Limit: test = 3.000000 >03/25/14 14:22:41 Limit: small.test = 2.000000 >03/25/14 14:22:41 Limit: medium.test = 5.000000 >03/25/14 14:22:41 Limit: undef.test = 1.000000 >03/25/14 14:22:41 Limit: undef = 1.000000 >03/25/14 14:22:41 Limit: large.test = 13.000000 >03/25/14 14:22:41 Limit: medium.undef = 5.000000 >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(medium.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(medium.undef) >03/25/14 14:22:41 IncrementLimit(small.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(medium.undef) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(medium.undef) >03/25/14 14:22:41 IncrementLimit(medium.undef) >03/25/14 14:22:41 IncrementLimit(medium.undef) >03/25/14 14:22:41 IncrementLimit(small.test) >03/25/14 14:22:41 IncrementLimit(test) >03/25/14 14:22:41 IncrementLimit(medium.test) >03/25/14 14:22:41 IncrementLimit(test) >03/25/14 14:22:41 IncrementLimit(medium.test) >03/25/14 14:22:41 IncrementLimit(test) >03/25/14 14:22:41 IncrementLimit(medium.test) >03/25/14 14:22:41 IncrementLimit(undef.test) >03/25/14 14:22:41 IncrementLimit(medium.test) >03/25/14 14:22:41 IncrementLimit(undef) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 IncrementLimit(large.test) >03/25/14 14:22:41 Current Limits -- >03/25/14 14:22:41 Limit: test = 3.000000 >03/25/14 14:22:41 Limit: small.test = 2.000000 >03/25/14 14:22:41 Limit: medium.test = 5.000000 >03/25/14 14:22:41 Limit: undef.test = 1.000000 >03/25/14 14:22:41 Limit: undef = 1.000000 >03/25/14 14:22:41 Limit: large.test = 13.000000 >03/25/14 14:22:41 Limit: medium.undef = 5.000000 >03/25/14 14:22:41 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:22:41 Phase 4.1: Negotiating with schedds ... >03/25/14 14:22:41 numSlots = 30 >03/25/14 14:22:41 slotWeightTotal = 30.000000 >03/25/14 14:22:41 pieLeft = 0.000 >03/25/14 14:22:41 NormalFactor = 1.000000 >03/25/14 14:22:41 MaxPrioValue = 0.945684 >03/25/14 14:22:41 NumSubmitterAds = 1 >03/25/14 14:22:41 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:22:41 0 seconds so far >03/25/14 14:22:41 Calculating submitter limit with the following parameters >03/25/14 14:22:41 SubmitterPrio = 0.945684 >03/25/14 14:22:41 SubmitterPrioFactor = 1.000000 >03/25/14 14:22:41 submitterShare = 1.000000 >03/25/14 14:22:41 submitterAbsShare = 1.000000 >03/25/14 14:22:41 submitterLimit = 0.000000 >03/25/14 14:22:41 submitterUsage = 30.000000 >03/25/14 14:22:41 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:22:41 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00011: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: large.test is 13.000000 >03/25/14 14:22:41 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:22:41 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00025: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:22:41 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:41 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00042: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: small.test is 2.000000 >03/25/14 14:22:41 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:22:41 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00063: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: test is 3.000000 >03/25/14 14:22:41 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:22:41 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00081: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:22:41 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:41 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00101: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: undef is 1.000000 >03/25/14 14:22:41 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:22:41 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:22:41 Request 00001.00125: >03/25/14 14:22:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:22:41 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:22:41 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:22:41 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:22:41 Sending SEND_JOB_INFO/eom >03/25/14 14:22:41 Getting reply from schedd ... >03/25/14 14:22:41 Got NO_MORE_JOBS; done negotiating >03/25/14 14:22:41 This submitter hit its submitterLimit. >03/25/14 14:22:41 resources used scheddUsed= 30.000000 >03/25/14 14:22:41 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:22:41 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:22:41 Getting monitoring info for pid 22893 >03/25/14 14:22:42 Getting monitoring info for pid 22893 >03/25/14 14:22:43 Getting monitoring info for pid 22893 >03/25/14 14:22:45 Getting monitoring info for pid 22893 >03/25/14 14:22:46 Getting monitoring info for pid 22893 >03/25/14 14:22:47 Getting monitoring info for pid 22893 >03/25/14 14:22:48 Getting monitoring info for pid 22893 >03/25/14 14:22:49 Getting monitoring info for pid 22893 >03/25/14 14:22:50 Getting monitoring info for pid 22893 >03/25/14 14:22:51 Getting monitoring info for pid 22893 >03/25/14 14:22:52 Getting monitoring info for pid 22893 >03/25/14 14:22:53 Getting monitoring info for pid 22893 >03/25/14 14:22:54 Getting monitoring info for pid 22893 >03/25/14 14:22:55 Getting monitoring info for pid 22893 >03/25/14 14:22:56 Getting monitoring info for pid 22893 >03/25/14 14:22:57 Getting monitoring info for pid 22893 >03/25/14 14:22:58 Getting monitoring info for pid 22893 >03/25/14 14:22:59 Getting monitoring info for pid 22893 >03/25/14 14:23:00 Getting monitoring info for pid 22893 >03/25/14 14:23:01 ---------- Started Negotiation Cycle ---------- >03/25/14 14:23:01 Phase 1: Obtaining ads from collector ... >03/25/14 14:23:01 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:23:01 Trying to query collector <IP:9618> >03/25/14 14:23:01 Sorting 32 ads ... >03/25/14 14:23:01 Getting startd private ads ... >03/25/14 14:23:01 Trying to query collector <IP:9618> >03/25/14 14:23:01 Got ads: 32 public and 30 private >03/25/14 14:23:01 Public ads include 1 submitter, 30 startd >03/25/14 14:23:01 Phase 2: Performing accounting ... >03/25/14 14:23:01 Entering compute_significant_attrs() >03/25/14 14:23:01 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:23:01 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:23:01 CustomerName=Customer.<none> , Old Priority=0.946 , New Priority=0.950 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=57525.000 (unweighted 57525.000), BeginUsageTime=1395751882 >03/25/14 14:23:01 CustomerName=Customer.test@<hostname> , Old Priority=0.946 , New Priority=0.950 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=57525.000 (unweighted 57525.000), BeginUsageTime=1395751882 >03/25/14 14:23:01 (Accountant) Checking Matches >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:23:01 Match already existed! >03/25/14 14:23:01 Previous Limits -- >03/25/14 14:23:01 Limit: test = 3.000000 >03/25/14 14:23:01 Limit: small.test = 2.000000 >03/25/14 14:23:01 Limit: medium.test = 5.000000 >03/25/14 14:23:01 Limit: undef.test = 1.000000 >03/25/14 14:23:01 Limit: undef = 1.000000 >03/25/14 14:23:01 Limit: large.test = 13.000000 >03/25/14 14:23:01 Limit: medium.undef = 5.000000 >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(medium.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(medium.undef) >03/25/14 14:23:01 IncrementLimit(small.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(medium.undef) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(medium.undef) >03/25/14 14:23:01 IncrementLimit(medium.undef) >03/25/14 14:23:01 IncrementLimit(medium.undef) >03/25/14 14:23:01 IncrementLimit(small.test) >03/25/14 14:23:01 IncrementLimit(test) >03/25/14 14:23:01 IncrementLimit(medium.test) >03/25/14 14:23:01 IncrementLimit(test) >03/25/14 14:23:01 IncrementLimit(medium.test) >03/25/14 14:23:01 IncrementLimit(test) >03/25/14 14:23:01 IncrementLimit(medium.test) >03/25/14 14:23:01 IncrementLimit(undef.test) >03/25/14 14:23:01 IncrementLimit(medium.test) >03/25/14 14:23:01 IncrementLimit(undef) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 IncrementLimit(large.test) >03/25/14 14:23:01 Current Limits -- >03/25/14 14:23:01 Limit: test = 3.000000 >03/25/14 14:23:01 Limit: small.test = 2.000000 >03/25/14 14:23:01 Limit: medium.test = 5.000000 >03/25/14 14:23:01 Limit: undef.test = 1.000000 >03/25/14 14:23:01 Limit: undef = 1.000000 >03/25/14 14:23:01 Limit: large.test = 13.000000 >03/25/14 14:23:01 Limit: medium.undef = 5.000000 >03/25/14 14:23:01 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:23:01 Phase 4.1: Negotiating with schedds ... >03/25/14 14:23:01 numSlots = 30 >03/25/14 14:23:01 slotWeightTotal = 30.000000 >03/25/14 14:23:01 pieLeft = 0.000 >03/25/14 14:23:01 NormalFactor = 1.000000 >03/25/14 14:23:01 MaxPrioValue = 0.950346 >03/25/14 14:23:01 NumSubmitterAds = 1 >03/25/14 14:23:01 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:23:01 0 seconds so far >03/25/14 14:23:01 Calculating submitter limit with the following parameters >03/25/14 14:23:01 SubmitterPrio = 0.950346 >03/25/14 14:23:01 SubmitterPrioFactor = 1.000000 >03/25/14 14:23:01 submitterShare = 1.000000 >03/25/14 14:23:01 submitterAbsShare = 1.000000 >03/25/14 14:23:01 submitterLimit = 0.000000 >03/25/14 14:23:01 submitterUsage = 30.000000 >03/25/14 14:23:01 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:23:01 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00011: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: large.test is 13.000000 >03/25/14 14:23:01 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:23:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00025: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:23:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00042: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: small.test is 2.000000 >03/25/14 14:23:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:23:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00063: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: test is 3.000000 >03/25/14 14:23:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:23:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00081: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:23:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00101: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: undef is 1.000000 >03/25/14 14:23:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:01 Request 00001.00125: >03/25/14 14:23:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:23:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:23:01 Sending SEND_JOB_INFO/eom >03/25/14 14:23:01 Getting reply from schedd ... >03/25/14 14:23:01 Got NO_MORE_JOBS; done negotiating >03/25/14 14:23:01 This submitter hit its submitterLimit. >03/25/14 14:23:01 resources used scheddUsed= 30.000000 >03/25/14 14:23:01 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:23:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:23:01 Getting monitoring info for pid 22893 >03/25/14 14:23:02 Getting monitoring info for pid 22893 >03/25/14 14:23:03 Getting monitoring info for pid 22893 >03/25/14 14:23:04 Getting monitoring info for pid 22893 >03/25/14 14:23:05 Getting monitoring info for pid 22893 >03/25/14 14:23:06 Getting monitoring info for pid 22893 >03/25/14 14:23:07 Getting monitoring info for pid 22893 >03/25/14 14:23:08 Getting monitoring info for pid 22893 >03/25/14 14:23:09 Getting monitoring info for pid 22893 >03/25/14 14:23:10 Getting monitoring info for pid 22893 >03/25/14 14:23:11 Getting monitoring info for pid 22893 >03/25/14 14:23:12 Getting monitoring info for pid 22893 >03/25/14 14:23:13 Getting monitoring info for pid 22893 >03/25/14 14:23:14 Getting monitoring info for pid 22893 >03/25/14 14:23:15 Getting monitoring info for pid 22893 >03/25/14 14:23:16 Getting monitoring info for pid 22893 >03/25/14 14:23:17 Getting monitoring info for pid 22893 >03/25/14 14:23:18 Getting monitoring info for pid 22893 >03/25/14 14:23:19 Getting monitoring info for pid 22893 >03/25/14 14:23:20 Getting monitoring info for pid 22893 >03/25/14 14:23:21 ---------- Started Negotiation Cycle ---------- >03/25/14 14:23:21 Phase 1: Obtaining ads from collector ... >03/25/14 14:23:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:23:21 Trying to query collector <IP:9618> >03/25/14 14:23:21 Sorting 32 ads ... >03/25/14 14:23:21 Getting startd private ads ... >03/25/14 14:23:21 Trying to query collector <IP:9618> >03/25/14 14:23:21 Got ads: 32 public and 30 private >03/25/14 14:23:21 Public ads include 1 submitter, 30 startd >03/25/14 14:23:21 Phase 2: Performing accounting ... >03/25/14 14:23:21 Entering compute_significant_attrs() >03/25/14 14:23:21 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:23:21 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:23:21 CustomerName=Customer.<none> , Old Priority=0.950 , New Priority=0.955 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=58125.000 (unweighted 58125.000), BeginUsageTime=1395751882 >03/25/14 14:23:21 CustomerName=Customer.test@<hostname> , Old Priority=0.950 , New Priority=0.955 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=58125.000 (unweighted 58125.000), BeginUsageTime=1395751882 >03/25/14 14:23:21 (Accountant) Checking Matches >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:23:21 Match already existed! >03/25/14 14:23:21 Previous Limits -- >03/25/14 14:23:21 Limit: test = 3.000000 >03/25/14 14:23:21 Limit: small.test = 2.000000 >03/25/14 14:23:21 Limit: medium.test = 5.000000 >03/25/14 14:23:21 Limit: undef.test = 1.000000 >03/25/14 14:23:21 Limit: undef = 1.000000 >03/25/14 14:23:21 Limit: large.test = 13.000000 >03/25/14 14:23:21 Limit: medium.undef = 5.000000 >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(medium.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(medium.undef) >03/25/14 14:23:21 IncrementLimit(small.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(medium.undef) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(medium.undef) >03/25/14 14:23:21 IncrementLimit(medium.undef) >03/25/14 14:23:21 IncrementLimit(medium.undef) >03/25/14 14:23:21 IncrementLimit(small.test) >03/25/14 14:23:21 IncrementLimit(test) >03/25/14 14:23:21 IncrementLimit(medium.test) >03/25/14 14:23:21 IncrementLimit(test) >03/25/14 14:23:21 IncrementLimit(medium.test) >03/25/14 14:23:21 IncrementLimit(test) >03/25/14 14:23:21 IncrementLimit(medium.test) >03/25/14 14:23:21 IncrementLimit(undef.test) >03/25/14 14:23:21 IncrementLimit(medium.test) >03/25/14 14:23:21 IncrementLimit(undef) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 IncrementLimit(large.test) >03/25/14 14:23:21 Current Limits -- >03/25/14 14:23:21 Limit: test = 3.000000 >03/25/14 14:23:21 Limit: small.test = 2.000000 >03/25/14 14:23:21 Limit: medium.test = 5.000000 >03/25/14 14:23:21 Limit: undef.test = 1.000000 >03/25/14 14:23:21 Limit: undef = 1.000000 >03/25/14 14:23:21 Limit: large.test = 13.000000 >03/25/14 14:23:21 Limit: medium.undef = 5.000000 >03/25/14 14:23:21 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:23:21 Phase 4.1: Negotiating with schedds ... >03/25/14 14:23:21 numSlots = 30 >03/25/14 14:23:21 slotWeightTotal = 30.000000 >03/25/14 14:23:21 pieLeft = 0.000 >03/25/14 14:23:21 NormalFactor = 1.000000 >03/25/14 14:23:21 MaxPrioValue = 0.955007 >03/25/14 14:23:21 NumSubmitterAds = 1 >03/25/14 14:23:21 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:23:21 0 seconds so far >03/25/14 14:23:21 Calculating submitter limit with the following parameters >03/25/14 14:23:21 SubmitterPrio = 0.955007 >03/25/14 14:23:21 SubmitterPrioFactor = 1.000000 >03/25/14 14:23:21 submitterShare = 1.000000 >03/25/14 14:23:21 submitterAbsShare = 1.000000 >03/25/14 14:23:21 submitterLimit = 0.000000 >03/25/14 14:23:21 submitterUsage = 30.000000 >03/25/14 14:23:21 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:23:21 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00011: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: large.test is 13.000000 >03/25/14 14:23:21 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:23:21 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00025: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:23:21 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:21 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00042: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: small.test is 2.000000 >03/25/14 14:23:21 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:23:21 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00063: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: test is 3.000000 >03/25/14 14:23:21 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:23:21 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00081: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:23:21 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:21 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00101: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: undef is 1.000000 >03/25/14 14:23:21 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:21 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:21 Request 00001.00125: >03/25/14 14:23:21 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:21 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:23:21 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:21 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:23:21 Sending SEND_JOB_INFO/eom >03/25/14 14:23:21 Getting reply from schedd ... >03/25/14 14:23:21 Got NO_MORE_JOBS; done negotiating >03/25/14 14:23:21 This submitter hit its submitterLimit. >03/25/14 14:23:21 resources used scheddUsed= 30.000000 >03/25/14 14:23:21 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:23:21 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:23:21 Getting monitoring info for pid 22893 >03/25/14 14:23:22 Getting monitoring info for pid 22893 >03/25/14 14:23:23 Getting monitoring info for pid 22893 >03/25/14 14:23:24 Getting monitoring info for pid 22893 >03/25/14 14:23:25 Getting monitoring info for pid 22893 >03/25/14 14:23:26 Getting monitoring info for pid 22893 >03/25/14 14:23:27 Getting monitoring info for pid 22893 >03/25/14 14:23:28 Getting monitoring info for pid 22893 >03/25/14 14:23:29 Getting monitoring info for pid 22893 >03/25/14 14:23:30 Getting monitoring info for pid 22893 >03/25/14 14:23:31 Getting monitoring info for pid 22893 >03/25/14 14:23:32 Getting monitoring info for pid 22893 >03/25/14 14:23:33 Getting monitoring info for pid 22893 >03/25/14 14:23:34 Getting monitoring info for pid 22893 >03/25/14 14:23:35 Getting monitoring info for pid 22893 >03/25/14 14:23:36 Getting monitoring info for pid 22893 >03/25/14 14:23:37 Getting monitoring info for pid 22893 >03/25/14 14:23:38 Getting monitoring info for pid 22893 >03/25/14 14:23:39 Getting monitoring info for pid 22893 >03/25/14 14:23:40 Getting monitoring info for pid 22893 >03/25/14 14:23:41 ---------- Started Negotiation Cycle ---------- >03/25/14 14:23:41 Phase 1: Obtaining ads from collector ... >03/25/14 14:23:41 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:23:41 Trying to query collector <IP:9618> >03/25/14 14:23:41 Sorting 32 ads ... >03/25/14 14:23:41 Getting startd private ads ... >03/25/14 14:23:41 Trying to query collector <IP:9618> >03/25/14 14:23:41 Got ads: 32 public and 30 private >03/25/14 14:23:41 Public ads include 1 submitter, 30 startd >03/25/14 14:23:41 Phase 2: Performing accounting ... >03/25/14 14:23:41 Entering compute_significant_attrs() >03/25/14 14:23:41 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:23:41 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:23:41 CustomerName=Customer.<none> , Old Priority=0.955 , New Priority=0.960 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=58725.000 (unweighted 58725.000), BeginUsageTime=1395751882 >03/25/14 14:23:41 CustomerName=Customer.test@<hostname> , Old Priority=0.955 , New Priority=0.960 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:23:41 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=58725.000 (unweighted 58725.000), BeginUsageTime=1395751882 >03/25/14 14:23:41 (Accountant) Checking Matches >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:23:41 Match already existed! >03/25/14 14:23:41 Previous Limits -- >03/25/14 14:23:41 Limit: test = 3.000000 >03/25/14 14:23:41 Limit: small.test = 2.000000 >03/25/14 14:23:41 Limit: medium.test = 5.000000 >03/25/14 14:23:41 Limit: undef.test = 1.000000 >03/25/14 14:23:41 Limit: undef = 1.000000 >03/25/14 14:23:41 Limit: large.test = 13.000000 >03/25/14 14:23:41 Limit: medium.undef = 5.000000 >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(medium.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(medium.undef) >03/25/14 14:23:41 IncrementLimit(small.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(medium.undef) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(medium.undef) >03/25/14 14:23:41 IncrementLimit(medium.undef) >03/25/14 14:23:41 IncrementLimit(medium.undef) >03/25/14 14:23:41 IncrementLimit(small.test) >03/25/14 14:23:41 IncrementLimit(test) >03/25/14 14:23:41 IncrementLimit(medium.test) >03/25/14 14:23:41 IncrementLimit(test) >03/25/14 14:23:41 IncrementLimit(medium.test) >03/25/14 14:23:41 IncrementLimit(test) >03/25/14 14:23:41 IncrementLimit(medium.test) >03/25/14 14:23:41 IncrementLimit(undef.test) >03/25/14 14:23:41 IncrementLimit(medium.test) >03/25/14 14:23:41 IncrementLimit(undef) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 IncrementLimit(large.test) >03/25/14 14:23:41 Current Limits -- >03/25/14 14:23:41 Limit: test = 3.000000 >03/25/14 14:23:41 Limit: small.test = 2.000000 >03/25/14 14:23:41 Limit: medium.test = 5.000000 >03/25/14 14:23:41 Limit: undef.test = 1.000000 >03/25/14 14:23:41 Limit: undef = 1.000000 >03/25/14 14:23:41 Limit: large.test = 13.000000 >03/25/14 14:23:41 Limit: medium.undef = 5.000000 >03/25/14 14:23:41 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:23:41 Phase 4.1: Negotiating with schedds ... >03/25/14 14:23:41 numSlots = 30 >03/25/14 14:23:41 slotWeightTotal = 30.000000 >03/25/14 14:23:41 pieLeft = 0.000 >03/25/14 14:23:41 NormalFactor = 1.000000 >03/25/14 14:23:41 MaxPrioValue = 0.959667 >03/25/14 14:23:41 NumSubmitterAds = 1 >03/25/14 14:23:41 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:23:41 0 seconds so far >03/25/14 14:23:41 Calculating submitter limit with the following parameters >03/25/14 14:23:41 SubmitterPrio = 0.959667 >03/25/14 14:23:41 SubmitterPrioFactor = 1.000000 >03/25/14 14:23:41 submitterShare = 1.000000 >03/25/14 14:23:41 submitterAbsShare = 1.000000 >03/25/14 14:23:41 submitterLimit = 0.000000 >03/25/14 14:23:41 submitterUsage = 30.000000 >03/25/14 14:23:41 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:23:41 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00011: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: large.test is 13.000000 >03/25/14 14:23:41 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:23:41 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00025: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:23:41 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:41 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00042: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: small.test is 2.000000 >03/25/14 14:23:41 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:23:41 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00063: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: test is 3.000000 >03/25/14 14:23:41 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:23:41 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00081: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:23:41 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:41 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00101: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: undef is 1.000000 >03/25/14 14:23:41 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:23:41 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got JOB_INFO command; getting classad/eom >03/25/14 14:23:41 Request 00001.00125: >03/25/14 14:23:41 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:23:41 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:23:41 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:23:41 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:23:41 Sending SEND_JOB_INFO/eom >03/25/14 14:23:41 Getting reply from schedd ... >03/25/14 14:23:41 Got NO_MORE_JOBS; done negotiating >03/25/14 14:23:41 This submitter hit its submitterLimit. >03/25/14 14:23:41 resources used scheddUsed= 30.000000 >03/25/14 14:23:41 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:23:41 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:23:41 Getting monitoring info for pid 22893 >03/25/14 14:23:42 Getting monitoring info for pid 22893 >03/25/14 14:23:43 Getting monitoring info for pid 22893 >03/25/14 14:23:44 Getting monitoring info for pid 22893 >03/25/14 14:23:45 Getting monitoring info for pid 22893 >03/25/14 14:23:46 Getting monitoring info for pid 22893 >03/25/14 14:23:47 Getting monitoring info for pid 22893 >03/25/14 14:23:48 Getting monitoring info for pid 22893 >03/25/14 14:23:49 Getting monitoring info for pid 22893 >03/25/14 14:23:50 Getting monitoring info for pid 22893 >03/25/14 14:23:51 Getting monitoring info for pid 22893 >03/25/14 14:23:52 Getting monitoring info for pid 22893 >03/25/14 14:23:53 Getting monitoring info for pid 22893 >03/25/14 14:23:54 Getting monitoring info for pid 22893 >03/25/14 14:23:55 Getting monitoring info for pid 22893 >03/25/14 14:23:56 Getting monitoring info for pid 22893 >03/25/14 14:23:57 Getting monitoring info for pid 22893 >03/25/14 14:23:58 Getting monitoring info for pid 22893 >03/25/14 14:23:59 Getting monitoring info for pid 22893 >03/25/14 14:24:00 Getting monitoring info for pid 22893 >03/25/14 14:24:01 ---------- Started Negotiation Cycle ---------- >03/25/14 14:24:01 Phase 1: Obtaining ads from collector ... >03/25/14 14:24:01 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:24:01 Trying to query collector <IP:9618> >03/25/14 14:24:01 Sorting 32 ads ... >03/25/14 14:24:01 Getting startd private ads ... >03/25/14 14:24:01 Trying to query collector <IP:9618> >03/25/14 14:24:01 Got ads: 32 public and 30 private >03/25/14 14:24:01 Public ads include 1 submitter, 30 startd >03/25/14 14:24:01 Phase 2: Performing accounting ... >03/25/14 14:24:01 Entering compute_significant_attrs() >03/25/14 14:24:01 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:24:01 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:24:01 CustomerName=Customer.<none> , Old Priority=0.960 , New Priority=0.964 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=59325.000 (unweighted 59325.000), BeginUsageTime=1395751882 >03/25/14 14:24:01 CustomerName=Customer.test@<hostname> , Old Priority=0.960 , New Priority=0.964 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:01 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=59325.000 (unweighted 59325.000), BeginUsageTime=1395751882 >03/25/14 14:24:01 (Accountant) Checking Matches >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:24:01 Match already existed! >03/25/14 14:24:01 Previous Limits -- >03/25/14 14:24:01 Limit: test = 3.000000 >03/25/14 14:24:01 Limit: small.test = 2.000000 >03/25/14 14:24:01 Limit: medium.test = 5.000000 >03/25/14 14:24:01 Limit: undef.test = 1.000000 >03/25/14 14:24:01 Limit: undef = 1.000000 >03/25/14 14:24:01 Limit: large.test = 13.000000 >03/25/14 14:24:01 Limit: medium.undef = 5.000000 >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(medium.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(medium.undef) >03/25/14 14:24:01 IncrementLimit(small.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(medium.undef) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(medium.undef) >03/25/14 14:24:01 IncrementLimit(medium.undef) >03/25/14 14:24:01 IncrementLimit(medium.undef) >03/25/14 14:24:01 IncrementLimit(small.test) >03/25/14 14:24:01 IncrementLimit(test) >03/25/14 14:24:01 IncrementLimit(medium.test) >03/25/14 14:24:01 IncrementLimit(test) >03/25/14 14:24:01 IncrementLimit(medium.test) >03/25/14 14:24:01 IncrementLimit(test) >03/25/14 14:24:01 IncrementLimit(medium.test) >03/25/14 14:24:01 IncrementLimit(undef.test) >03/25/14 14:24:01 IncrementLimit(medium.test) >03/25/14 14:24:01 IncrementLimit(undef) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 IncrementLimit(large.test) >03/25/14 14:24:01 Current Limits -- >03/25/14 14:24:01 Limit: test = 3.000000 >03/25/14 14:24:01 Limit: small.test = 2.000000 >03/25/14 14:24:01 Limit: medium.test = 5.000000 >03/25/14 14:24:01 Limit: undef.test = 1.000000 >03/25/14 14:24:01 Limit: undef = 1.000000 >03/25/14 14:24:01 Limit: large.test = 13.000000 >03/25/14 14:24:01 Limit: medium.undef = 5.000000 >03/25/14 14:24:01 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:24:01 Phase 4.1: Negotiating with schedds ... >03/25/14 14:24:01 numSlots = 30 >03/25/14 14:24:01 slotWeightTotal = 30.000000 >03/25/14 14:24:01 pieLeft = 0.000 >03/25/14 14:24:01 NormalFactor = 1.000000 >03/25/14 14:24:01 MaxPrioValue = 0.964327 >03/25/14 14:24:01 NumSubmitterAds = 1 >03/25/14 14:24:01 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:24:01 0 seconds so far >03/25/14 14:24:01 Calculating submitter limit with the following parameters >03/25/14 14:24:01 SubmitterPrio = 0.964327 >03/25/14 14:24:01 SubmitterPrioFactor = 1.000000 >03/25/14 14:24:01 submitterShare = 1.000000 >03/25/14 14:24:01 submitterAbsShare = 1.000000 >03/25/14 14:24:01 submitterLimit = 0.000000 >03/25/14 14:24:01 submitterUsage = 30.000000 >03/25/14 14:24:01 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:24:01 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00011: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: large.test is 13.000000 >03/25/14 14:24:01 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:24:01 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00025: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:24:01 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:01 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00042: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: small.test is 2.000000 >03/25/14 14:24:01 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:24:01 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00063: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: test is 3.000000 >03/25/14 14:24:01 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:24:01 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00081: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:24:01 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:01 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00101: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: undef is 1.000000 >03/25/14 14:24:01 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:01 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:01 Request 00001.00125: >03/25/14 14:24:01 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:01 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:24:01 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:01 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:24:01 Sending SEND_JOB_INFO/eom >03/25/14 14:24:01 Getting reply from schedd ... >03/25/14 14:24:01 Got NO_MORE_JOBS; done negotiating >03/25/14 14:24:01 This submitter hit its submitterLimit. >03/25/14 14:24:01 resources used scheddUsed= 30.000000 >03/25/14 14:24:01 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:24:01 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:24:01 Getting monitoring info for pid 22893 >03/25/14 14:24:02 Getting monitoring info for pid 22893 >03/25/14 14:24:03 Getting monitoring info for pid 22893 >03/25/14 14:24:04 Getting monitoring info for pid 22893 >03/25/14 14:24:05 Getting monitoring info for pid 22893 >03/25/14 14:24:06 Getting monitoring info for pid 22893 >03/25/14 14:24:07 Getting monitoring info for pid 22893 >03/25/14 14:24:08 Getting monitoring info for pid 22893 >03/25/14 14:24:09 Getting monitoring info for pid 22893 >03/25/14 14:24:10 Getting monitoring info for pid 22893 >03/25/14 14:24:11 Getting monitoring info for pid 22893 >03/25/14 14:24:12 Getting monitoring info for pid 22893 >03/25/14 14:24:13 Getting monitoring info for pid 22893 >03/25/14 14:24:14 Getting monitoring info for pid 22893 >03/25/14 14:24:15 Getting monitoring info for pid 22893 >03/25/14 14:24:16 Getting monitoring info for pid 22893 >03/25/14 14:24:17 Getting monitoring info for pid 22893 >03/25/14 14:24:18 Getting monitoring info for pid 22893 >03/25/14 14:24:19 Getting monitoring info for pid 22893 >03/25/14 14:24:20 Getting monitoring info for pid 22893 >03/25/14 14:24:21 ---------- Started Negotiation Cycle ---------- >03/25/14 14:24:21 Phase 1: Obtaining ads from collector ... >03/25/14 14:24:21 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:24:21 Trying to query collector <IP:9618> >03/25/14 14:24:21 Sorting 32 ads ... >03/25/14 14:24:21 Getting startd private ads ... >03/25/14 14:24:21 Trying to query collector <IP:9618> >03/25/14 14:24:21 Got ads: 32 public and 30 private >03/25/14 14:24:21 Public ads include 1 submitter, 30 startd >03/25/14 14:24:21 Phase 2: Performing accounting ... >03/25/14 14:24:21 Entering compute_significant_attrs() >03/25/14 14:24:21 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:24:21 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:24:21 CustomerName=Customer.<none> , Old Priority=0.964 , New Priority=0.969 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=59925.000 (unweighted 59925.000), BeginUsageTime=1395751882 >03/25/14 14:24:21 CustomerName=Customer.test@<hostname> , Old Priority=0.964 , New Priority=0.969 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:21 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=59925.000 (unweighted 59925.000), BeginUsageTime=1395751882 >03/25/14 14:24:22 (Accountant) Checking Matches >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:24:22 Match already existed! >03/25/14 14:24:22 Previous Limits -- >03/25/14 14:24:22 Limit: test = 3.000000 >03/25/14 14:24:22 Limit: small.test = 2.000000 >03/25/14 14:24:22 Limit: medium.test = 5.000000 >03/25/14 14:24:22 Limit: undef.test = 1.000000 >03/25/14 14:24:22 Limit: undef = 1.000000 >03/25/14 14:24:22 Limit: large.test = 13.000000 >03/25/14 14:24:22 Limit: medium.undef = 5.000000 >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(medium.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(medium.undef) >03/25/14 14:24:22 IncrementLimit(small.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(medium.undef) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(medium.undef) >03/25/14 14:24:22 IncrementLimit(medium.undef) >03/25/14 14:24:22 IncrementLimit(medium.undef) >03/25/14 14:24:22 IncrementLimit(small.test) >03/25/14 14:24:22 IncrementLimit(test) >03/25/14 14:24:22 IncrementLimit(medium.test) >03/25/14 14:24:22 IncrementLimit(test) >03/25/14 14:24:22 IncrementLimit(medium.test) >03/25/14 14:24:22 IncrementLimit(test) >03/25/14 14:24:22 IncrementLimit(medium.test) >03/25/14 14:24:22 IncrementLimit(undef.test) >03/25/14 14:24:22 IncrementLimit(medium.test) >03/25/14 14:24:22 IncrementLimit(undef) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 IncrementLimit(large.test) >03/25/14 14:24:22 Current Limits -- >03/25/14 14:24:22 Limit: test = 3.000000 >03/25/14 14:24:22 Limit: small.test = 2.000000 >03/25/14 14:24:22 Limit: medium.test = 5.000000 >03/25/14 14:24:22 Limit: undef.test = 1.000000 >03/25/14 14:24:22 Limit: undef = 1.000000 >03/25/14 14:24:22 Limit: large.test = 13.000000 >03/25/14 14:24:22 Limit: medium.undef = 5.000000 >03/25/14 14:24:22 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:24:22 Phase 4.1: Negotiating with schedds ... >03/25/14 14:24:22 numSlots = 30 >03/25/14 14:24:22 slotWeightTotal = 30.000000 >03/25/14 14:24:22 pieLeft = 0.000 >03/25/14 14:24:22 NormalFactor = 1.000000 >03/25/14 14:24:22 MaxPrioValue = 0.968986 >03/25/14 14:24:22 NumSubmitterAds = 1 >03/25/14 14:24:22 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:24:22 0 seconds so far >03/25/14 14:24:22 Calculating submitter limit with the following parameters >03/25/14 14:24:22 SubmitterPrio = 0.968986 >03/25/14 14:24:22 SubmitterPrioFactor = 1.000000 >03/25/14 14:24:22 submitterShare = 1.000000 >03/25/14 14:24:22 submitterAbsShare = 1.000000 >03/25/14 14:24:22 submitterLimit = 0.000000 >03/25/14 14:24:22 submitterUsage = 30.000000 >03/25/14 14:24:22 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:24:22 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00011: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: large.test is 13.000000 >03/25/14 14:24:22 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:24:22 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00025: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:24:22 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:22 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00042: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: small.test is 2.000000 >03/25/14 14:24:22 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:24:22 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00063: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: test is 3.000000 >03/25/14 14:24:22 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:24:22 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00081: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:24:22 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:22 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00101: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: undef is 1.000000 >03/25/14 14:24:22 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:22 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:22 Request 00001.00125: >03/25/14 14:24:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:22 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:24:22 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:22 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:24:22 Sending SEND_JOB_INFO/eom >03/25/14 14:24:22 Getting reply from schedd ... >03/25/14 14:24:22 Got NO_MORE_JOBS; done negotiating >03/25/14 14:24:22 This submitter hit its submitterLimit. >03/25/14 14:24:22 resources used scheddUsed= 30.000000 >03/25/14 14:24:22 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:24:22 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:24:22 Getting monitoring info for pid 22893 >03/25/14 14:24:23 Getting monitoring info for pid 22893 >03/25/14 14:24:24 Getting monitoring info for pid 22893 >03/25/14 14:24:25 Getting monitoring info for pid 22893 >03/25/14 14:24:26 Getting monitoring info for pid 22893 >03/25/14 14:24:27 Getting monitoring info for pid 22893 >03/25/14 14:24:28 Getting monitoring info for pid 22893 >03/25/14 14:24:29 Getting monitoring info for pid 22893 >03/25/14 14:24:30 Getting monitoring info for pid 22893 >03/25/14 14:24:31 Getting monitoring info for pid 22893 >03/25/14 14:24:32 Getting monitoring info for pid 22893 >03/25/14 14:24:33 Getting monitoring info for pid 22893 >03/25/14 14:24:34 Getting monitoring info for pid 22893 >03/25/14 14:24:35 Getting monitoring info for pid 22893 >03/25/14 14:24:36 Getting monitoring info for pid 22893 >03/25/14 14:24:37 Getting monitoring info for pid 22893 >03/25/14 14:24:38 Getting monitoring info for pid 22893 >03/25/14 14:24:39 Getting monitoring info for pid 22893 >03/25/14 14:24:40 Getting monitoring info for pid 22893 >03/25/14 14:24:41 Getting monitoring info for pid 22893 >03/25/14 14:24:42 ---------- Started Negotiation Cycle ---------- >03/25/14 14:24:42 Phase 1: Obtaining ads from collector ... >03/25/14 14:24:42 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:24:42 Trying to query collector <IP:9618> >03/25/14 14:24:42 Sorting 32 ads ... >03/25/14 14:24:42 Getting startd private ads ... >03/25/14 14:24:42 Trying to query collector <IP:9618> >03/25/14 14:24:42 Got ads: 32 public and 30 private >03/25/14 14:24:42 Public ads include 1 submitter, 30 startd >03/25/14 14:24:42 Phase 2: Performing accounting ... >03/25/14 14:24:42 Entering compute_significant_attrs() >03/25/14 14:24:42 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:24:42 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=21 >03/25/14 14:24:42 CustomerName=Customer.<none> , Old Priority=0.969 , New Priority=0.974 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=60555.000 (unweighted 60555.000), BeginUsageTime=1395751882 >03/25/14 14:24:42 CustomerName=Customer.test@<hostname> , Old Priority=0.969 , New Priority=0.974 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:24:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=60555.000 (unweighted 60555.000), BeginUsageTime=1395751882 >03/25/14 14:24:42 (Accountant) Checking Matches >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:24:42 Match already existed! >03/25/14 14:24:42 Previous Limits -- >03/25/14 14:24:42 Limit: test = 3.000000 >03/25/14 14:24:42 Limit: small.test = 2.000000 >03/25/14 14:24:42 Limit: medium.test = 5.000000 >03/25/14 14:24:42 Limit: undef.test = 1.000000 >03/25/14 14:24:42 Limit: undef = 1.000000 >03/25/14 14:24:42 Limit: large.test = 13.000000 >03/25/14 14:24:42 Limit: medium.undef = 5.000000 >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(medium.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(medium.undef) >03/25/14 14:24:42 IncrementLimit(small.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(medium.undef) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(medium.undef) >03/25/14 14:24:42 IncrementLimit(medium.undef) >03/25/14 14:24:42 IncrementLimit(medium.undef) >03/25/14 14:24:42 IncrementLimit(small.test) >03/25/14 14:24:42 IncrementLimit(test) >03/25/14 14:24:42 IncrementLimit(medium.test) >03/25/14 14:24:42 IncrementLimit(test) >03/25/14 14:24:42 IncrementLimit(medium.test) >03/25/14 14:24:42 IncrementLimit(test) >03/25/14 14:24:42 IncrementLimit(medium.test) >03/25/14 14:24:42 IncrementLimit(undef.test) >03/25/14 14:24:42 IncrementLimit(medium.test) >03/25/14 14:24:42 IncrementLimit(undef) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 IncrementLimit(large.test) >03/25/14 14:24:42 Current Limits -- >03/25/14 14:24:42 Limit: test = 3.000000 >03/25/14 14:24:42 Limit: small.test = 2.000000 >03/25/14 14:24:42 Limit: medium.test = 5.000000 >03/25/14 14:24:42 Limit: undef.test = 1.000000 >03/25/14 14:24:42 Limit: undef = 1.000000 >03/25/14 14:24:42 Limit: large.test = 13.000000 >03/25/14 14:24:42 Limit: medium.undef = 5.000000 >03/25/14 14:24:42 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:24:42 Phase 4.1: Negotiating with schedds ... >03/25/14 14:24:42 numSlots = 30 >03/25/14 14:24:42 slotWeightTotal = 30.000000 >03/25/14 14:24:42 pieLeft = 0.000 >03/25/14 14:24:42 NormalFactor = 1.000000 >03/25/14 14:24:42 MaxPrioValue = 0.973876 >03/25/14 14:24:42 NumSubmitterAds = 1 >03/25/14 14:24:42 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:24:42 0 seconds so far >03/25/14 14:24:42 Calculating submitter limit with the following parameters >03/25/14 14:24:42 SubmitterPrio = 0.973876 >03/25/14 14:24:42 SubmitterPrioFactor = 1.000000 >03/25/14 14:24:42 submitterShare = 1.000000 >03/25/14 14:24:42 submitterAbsShare = 1.000000 >03/25/14 14:24:42 submitterLimit = 0.000000 >03/25/14 14:24:42 submitterUsage = 30.000000 >03/25/14 14:24:42 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:24:42 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00011: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: large.test is 13.000000 >03/25/14 14:24:42 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:24:42 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00025: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:24:42 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:42 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00042: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: small.test is 2.000000 >03/25/14 14:24:42 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:24:42 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00063: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: test is 3.000000 >03/25/14 14:24:42 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:24:42 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00081: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:24:42 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:42 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00101: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: undef is 1.000000 >03/25/14 14:24:42 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:24:42 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:24:42 Request 00001.00125: >03/25/14 14:24:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:24:42 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:24:42 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:24:42 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:24:42 Sending SEND_JOB_INFO/eom >03/25/14 14:24:42 Getting reply from schedd ... >03/25/14 14:24:42 Got NO_MORE_JOBS; done negotiating >03/25/14 14:24:42 This submitter hit its submitterLimit. >03/25/14 14:24:42 resources used scheddUsed= 30.000000 >03/25/14 14:24:42 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:24:42 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:24:42 Getting monitoring info for pid 22893 >03/25/14 14:24:43 Getting monitoring info for pid 22893 >03/25/14 14:24:44 Getting monitoring info for pid 22893 >03/25/14 14:24:45 Getting monitoring info for pid 22893 >03/25/14 14:24:46 Getting monitoring info for pid 22893 >03/25/14 14:24:47 Getting monitoring info for pid 22893 >03/25/14 14:24:48 Getting monitoring info for pid 22893 >03/25/14 14:24:49 Getting monitoring info for pid 22893 >03/25/14 14:24:50 Getting monitoring info for pid 22893 >03/25/14 14:24:51 Getting monitoring info for pid 22893 >03/25/14 14:24:52 Getting monitoring info for pid 22893 >03/25/14 14:24:53 Getting monitoring info for pid 22893 >03/25/14 14:24:54 Getting monitoring info for pid 22893 >03/25/14 14:24:55 Getting monitoring info for pid 22893 >03/25/14 14:24:56 Getting monitoring info for pid 22893 >03/25/14 14:24:57 Getting monitoring info for pid 22893 >03/25/14 14:24:58 Getting monitoring info for pid 22893 >03/25/14 14:24:59 Getting monitoring info for pid 22893 >03/25/14 14:25:00 Getting monitoring info for pid 22893 >03/25/14 14:25:01 Getting monitoring info for pid 22893 >03/25/14 14:25:02 ---------- Started Negotiation Cycle ---------- >03/25/14 14:25:02 Phase 1: Obtaining ads from collector ... >03/25/14 14:25:02 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:25:02 Trying to query collector <IP:9618> >03/25/14 14:25:02 Sorting 32 ads ... >03/25/14 14:25:02 Getting startd private ads ... >03/25/14 14:25:02 Trying to query collector <IP:9618> >03/25/14 14:25:02 Got ads: 32 public and 30 private >03/25/14 14:25:02 Public ads include 1 submitter, 30 startd >03/25/14 14:25:02 Phase 2: Performing accounting ... >03/25/14 14:25:02 Entering compute_significant_attrs() >03/25/14 14:25:02 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:25:02 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:25:02 CustomerName=Customer.<none> , Old Priority=0.974 , New Priority=0.979 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=61155.000 (unweighted 61155.000), BeginUsageTime=1395751882 >03/25/14 14:25:02 CustomerName=Customer.test@<hostname> , Old Priority=0.974 , New Priority=0.979 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=61155.000 (unweighted 61155.000), BeginUsageTime=1395751882 >03/25/14 14:25:02 (Accountant) Checking Matches >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:25:02 Match already existed! >03/25/14 14:25:02 Previous Limits -- >03/25/14 14:25:02 Limit: test = 3.000000 >03/25/14 14:25:02 Limit: small.test = 2.000000 >03/25/14 14:25:02 Limit: medium.test = 5.000000 >03/25/14 14:25:02 Limit: undef.test = 1.000000 >03/25/14 14:25:02 Limit: undef = 1.000000 >03/25/14 14:25:02 Limit: large.test = 13.000000 >03/25/14 14:25:02 Limit: medium.undef = 5.000000 >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(medium.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(medium.undef) >03/25/14 14:25:02 IncrementLimit(small.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(medium.undef) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(medium.undef) >03/25/14 14:25:02 IncrementLimit(medium.undef) >03/25/14 14:25:02 IncrementLimit(medium.undef) >03/25/14 14:25:02 IncrementLimit(small.test) >03/25/14 14:25:02 IncrementLimit(test) >03/25/14 14:25:02 IncrementLimit(medium.test) >03/25/14 14:25:02 IncrementLimit(test) >03/25/14 14:25:02 IncrementLimit(medium.test) >03/25/14 14:25:02 IncrementLimit(test) >03/25/14 14:25:02 IncrementLimit(medium.test) >03/25/14 14:25:02 IncrementLimit(undef.test) >03/25/14 14:25:02 IncrementLimit(medium.test) >03/25/14 14:25:02 IncrementLimit(undef) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 IncrementLimit(large.test) >03/25/14 14:25:02 Current Limits -- >03/25/14 14:25:02 Limit: test = 3.000000 >03/25/14 14:25:02 Limit: small.test = 2.000000 >03/25/14 14:25:02 Limit: medium.test = 5.000000 >03/25/14 14:25:02 Limit: undef.test = 1.000000 >03/25/14 14:25:02 Limit: undef = 1.000000 >03/25/14 14:25:02 Limit: large.test = 13.000000 >03/25/14 14:25:02 Limit: medium.undef = 5.000000 >03/25/14 14:25:02 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:25:02 Phase 4.1: Negotiating with schedds ... >03/25/14 14:25:02 numSlots = 30 >03/25/14 14:25:02 slotWeightTotal = 30.000000 >03/25/14 14:25:02 pieLeft = 0.000 >03/25/14 14:25:02 NormalFactor = 1.000000 >03/25/14 14:25:02 MaxPrioValue = 0.978533 >03/25/14 14:25:02 NumSubmitterAds = 1 >03/25/14 14:25:02 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:25:02 0 seconds so far >03/25/14 14:25:02 Calculating submitter limit with the following parameters >03/25/14 14:25:02 SubmitterPrio = 0.978533 >03/25/14 14:25:02 SubmitterPrioFactor = 1.000000 >03/25/14 14:25:02 submitterShare = 1.000000 >03/25/14 14:25:02 submitterAbsShare = 1.000000 >03/25/14 14:25:02 submitterLimit = 0.000000 >03/25/14 14:25:02 submitterUsage = 30.000000 >03/25/14 14:25:02 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:25:02 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00011: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: large.test is 13.000000 >03/25/14 14:25:02 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:25:02 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00025: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:25:02 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:02 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00042: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: small.test is 2.000000 >03/25/14 14:25:02 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:25:02 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00063: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: test is 3.000000 >03/25/14 14:25:02 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:25:02 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00081: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:25:02 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:02 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00101: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: undef is 1.000000 >03/25/14 14:25:02 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:02 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:02 Request 00001.00125: >03/25/14 14:25:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:02 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:25:02 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:02 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:25:02 Sending SEND_JOB_INFO/eom >03/25/14 14:25:02 Getting reply from schedd ... >03/25/14 14:25:02 Got NO_MORE_JOBS; done negotiating >03/25/14 14:25:02 This submitter hit its submitterLimit. >03/25/14 14:25:02 resources used scheddUsed= 30.000000 >03/25/14 14:25:02 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:25:02 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:25:02 Getting monitoring info for pid 22893 >03/25/14 14:25:03 Getting monitoring info for pid 22893 >03/25/14 14:25:04 Getting monitoring info for pid 22893 >03/25/14 14:25:05 Getting monitoring info for pid 22893 >03/25/14 14:25:06 Getting monitoring info for pid 22893 >03/25/14 14:25:07 Getting monitoring info for pid 22893 >03/25/14 14:25:08 Getting monitoring info for pid 22893 >03/25/14 14:25:09 Getting monitoring info for pid 22893 >03/25/14 14:25:10 Getting monitoring info for pid 22893 >03/25/14 14:25:11 Getting monitoring info for pid 22893 >03/25/14 14:25:12 Getting monitoring info for pid 22893 >03/25/14 14:25:13 Getting monitoring info for pid 22893 >03/25/14 14:25:14 Getting monitoring info for pid 22893 >03/25/14 14:25:15 Getting monitoring info for pid 22893 >03/25/14 14:25:16 Getting monitoring info for pid 22893 >03/25/14 14:25:17 Getting monitoring info for pid 22893 >03/25/14 14:25:18 Getting monitoring info for pid 22893 >03/25/14 14:25:19 Getting monitoring info for pid 22893 >03/25/14 14:25:20 Getting monitoring info for pid 22893 >03/25/14 14:25:21 Getting monitoring info for pid 22893 >03/25/14 14:25:22 ---------- Started Negotiation Cycle ---------- >03/25/14 14:25:22 Phase 1: Obtaining ads from collector ... >03/25/14 14:25:22 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:25:22 Trying to query collector <IP:9618> >03/25/14 14:25:22 Sorting 32 ads ... >03/25/14 14:25:22 Getting startd private ads ... >03/25/14 14:25:22 Trying to query collector <IP:9618> >03/25/14 14:25:22 Got ads: 32 public and 30 private >03/25/14 14:25:22 Public ads include 1 submitter, 30 startd >03/25/14 14:25:22 Phase 2: Performing accounting ... >03/25/14 14:25:22 Entering compute_significant_attrs() >03/25/14 14:25:22 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:25:22 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:25:22 CustomerName=Customer.<none> , Old Priority=0.979 , New Priority=0.983 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=61755.000 (unweighted 61755.000), BeginUsageTime=1395751882 >03/25/14 14:25:22 CustomerName=Customer.test@<hostname> , Old Priority=0.979 , New Priority=0.983 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:22 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=61755.000 (unweighted 61755.000), BeginUsageTime=1395751882 >03/25/14 14:25:22 (Accountant) Checking Matches >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:25:22 Match already existed! >03/25/14 14:25:22 Previous Limits -- >03/25/14 14:25:22 Limit: test = 3.000000 >03/25/14 14:25:22 Limit: small.test = 2.000000 >03/25/14 14:25:22 Limit: medium.test = 5.000000 >03/25/14 14:25:22 Limit: undef.test = 1.000000 >03/25/14 14:25:22 Limit: undef = 1.000000 >03/25/14 14:25:22 Limit: large.test = 13.000000 >03/25/14 14:25:22 Limit: medium.undef = 5.000000 >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(medium.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(medium.undef) >03/25/14 14:25:22 IncrementLimit(small.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(medium.undef) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(medium.undef) >03/25/14 14:25:22 IncrementLimit(medium.undef) >03/25/14 14:25:22 IncrementLimit(medium.undef) >03/25/14 14:25:22 IncrementLimit(small.test) >03/25/14 14:25:22 IncrementLimit(test) >03/25/14 14:25:22 IncrementLimit(medium.test) >03/25/14 14:25:22 IncrementLimit(test) >03/25/14 14:25:22 IncrementLimit(medium.test) >03/25/14 14:25:22 IncrementLimit(test) >03/25/14 14:25:22 IncrementLimit(medium.test) >03/25/14 14:25:22 IncrementLimit(undef.test) >03/25/14 14:25:22 IncrementLimit(medium.test) >03/25/14 14:25:22 IncrementLimit(undef) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 IncrementLimit(large.test) >03/25/14 14:25:22 Current Limits -- >03/25/14 14:25:22 Limit: test = 3.000000 >03/25/14 14:25:22 Limit: small.test = 2.000000 >03/25/14 14:25:22 Limit: medium.test = 5.000000 >03/25/14 14:25:22 Limit: undef.test = 1.000000 >03/25/14 14:25:22 Limit: undef = 1.000000 >03/25/14 14:25:22 Limit: large.test = 13.000000 >03/25/14 14:25:22 Limit: medium.undef = 5.000000 >03/25/14 14:25:22 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:25:22 Phase 4.1: Negotiating with schedds ... >03/25/14 14:25:22 numSlots = 30 >03/25/14 14:25:22 slotWeightTotal = 30.000000 >03/25/14 14:25:22 pieLeft = 0.000 >03/25/14 14:25:22 NormalFactor = 1.000000 >03/25/14 14:25:22 MaxPrioValue = 0.983190 >03/25/14 14:25:22 NumSubmitterAds = 1 >03/25/14 14:25:22 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:25:22 0 seconds so far >03/25/14 14:25:22 Calculating submitter limit with the following parameters >03/25/14 14:25:22 SubmitterPrio = 0.983190 >03/25/14 14:25:22 SubmitterPrioFactor = 1.000000 >03/25/14 14:25:22 submitterShare = 1.000000 >03/25/14 14:25:22 submitterAbsShare = 1.000000 >03/25/14 14:25:22 submitterLimit = 0.000000 >03/25/14 14:25:22 submitterUsage = 30.000000 >03/25/14 14:25:22 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:25:22 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00011: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: large.test is 13.000000 >03/25/14 14:25:22 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:25:22 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00025: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:25:22 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:22 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00042: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: small.test is 2.000000 >03/25/14 14:25:22 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:25:22 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00063: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: test is 3.000000 >03/25/14 14:25:22 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:25:22 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00081: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:25:22 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:22 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00101: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: undef is 1.000000 >03/25/14 14:25:22 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:22 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:22 Request 00001.00125: >03/25/14 14:25:22 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:22 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:25:22 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:22 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:25:22 Sending SEND_JOB_INFO/eom >03/25/14 14:25:22 Getting reply from schedd ... >03/25/14 14:25:22 Got NO_MORE_JOBS; done negotiating >03/25/14 14:25:22 This submitter hit its submitterLimit. >03/25/14 14:25:22 resources used scheddUsed= 30.000000 >03/25/14 14:25:22 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:25:22 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:25:22 Getting monitoring info for pid 22893 >03/25/14 14:25:23 Getting monitoring info for pid 22893 >03/25/14 14:25:24 Getting monitoring info for pid 22893 >03/25/14 14:25:25 Getting monitoring info for pid 22893 >03/25/14 14:25:26 Getting monitoring info for pid 22893 >03/25/14 14:25:27 Getting monitoring info for pid 22893 >03/25/14 14:25:29 Getting monitoring info for pid 22893 >03/25/14 14:25:30 enter Matchmaker::updateCollector >03/25/14 14:25:30 Warning: Could not find DaemonStartTime >03/25/14 14:25:30 Trying to update collector <IP:9618> >03/25/14 14:25:30 Attempting to send update via UDP to collector <hostname> <IP:9618> >03/25/14 14:25:30 exit Matchmaker::UpdateCollector >03/25/14 14:25:30 Getting monitoring info for pid 22893 >03/25/14 14:25:31 Getting monitoring info for pid 22893 >03/25/14 14:25:32 Getting monitoring info for pid 22893 >03/25/14 14:25:33 Getting monitoring info for pid 22893 >03/25/14 14:25:34 Getting monitoring info for pid 22893 >03/25/14 14:25:35 Getting monitoring info for pid 22893 >03/25/14 14:25:36 Getting monitoring info for pid 22893 >03/25/14 14:25:37 Getting monitoring info for pid 22893 >03/25/14 14:25:38 Getting monitoring info for pid 22893 >03/25/14 14:25:39 Getting monitoring info for pid 22893 >03/25/14 14:25:40 Getting monitoring info for pid 22893 >03/25/14 14:25:41 Getting monitoring info for pid 22893 >03/25/14 14:25:42 ---------- Started Negotiation Cycle ---------- >03/25/14 14:25:42 Phase 1: Obtaining ads from collector ... >03/25/14 14:25:42 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:25:42 Trying to query collector <IP:9618> >03/25/14 14:25:42 Sorting 32 ads ... >03/25/14 14:25:42 Getting startd private ads ... >03/25/14 14:25:42 Trying to query collector <IP:9618> >03/25/14 14:25:42 Got ads: 32 public and 30 private >03/25/14 14:25:42 Public ads include 1 submitter, 30 startd >03/25/14 14:25:42 Phase 2: Performing accounting ... >03/25/14 14:25:42 Entering compute_significant_attrs() >03/25/14 14:25:42 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:25:42 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:25:42 CustomerName=Customer.<none> , Old Priority=0.983 , New Priority=0.988 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=62355.000 (unweighted 62355.000), BeginUsageTime=1395751882 >03/25/14 14:25:42 CustomerName=Customer.test@<hostname> , Old Priority=0.983 , New Priority=0.988 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:25:42 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=62355.000 (unweighted 62355.000), BeginUsageTime=1395751882 >03/25/14 14:25:42 (Accountant) Checking Matches >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:25:42 Match already existed! >03/25/14 14:25:42 Previous Limits -- >03/25/14 14:25:42 Limit: test = 3.000000 >03/25/14 14:25:42 Limit: small.test = 2.000000 >03/25/14 14:25:42 Limit: medium.test = 5.000000 >03/25/14 14:25:42 Limit: undef.test = 1.000000 >03/25/14 14:25:42 Limit: undef = 1.000000 >03/25/14 14:25:42 Limit: large.test = 13.000000 >03/25/14 14:25:42 Limit: medium.undef = 5.000000 >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(medium.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(medium.undef) >03/25/14 14:25:42 IncrementLimit(small.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(medium.undef) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(medium.undef) >03/25/14 14:25:42 IncrementLimit(medium.undef) >03/25/14 14:25:42 IncrementLimit(medium.undef) >03/25/14 14:25:42 IncrementLimit(small.test) >03/25/14 14:25:42 IncrementLimit(test) >03/25/14 14:25:42 IncrementLimit(medium.test) >03/25/14 14:25:42 IncrementLimit(test) >03/25/14 14:25:42 IncrementLimit(medium.test) >03/25/14 14:25:42 IncrementLimit(test) >03/25/14 14:25:42 IncrementLimit(medium.test) >03/25/14 14:25:42 IncrementLimit(undef.test) >03/25/14 14:25:42 IncrementLimit(medium.test) >03/25/14 14:25:42 IncrementLimit(undef) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 IncrementLimit(large.test) >03/25/14 14:25:42 Current Limits -- >03/25/14 14:25:42 Limit: test = 3.000000 >03/25/14 14:25:42 Limit: small.test = 2.000000 >03/25/14 14:25:42 Limit: medium.test = 5.000000 >03/25/14 14:25:42 Limit: undef.test = 1.000000 >03/25/14 14:25:42 Limit: undef = 1.000000 >03/25/14 14:25:42 Limit: large.test = 13.000000 >03/25/14 14:25:42 Limit: medium.undef = 5.000000 >03/25/14 14:25:42 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:25:42 Phase 4.1: Negotiating with schedds ... >03/25/14 14:25:42 numSlots = 30 >03/25/14 14:25:42 slotWeightTotal = 30.000000 >03/25/14 14:25:42 pieLeft = 0.000 >03/25/14 14:25:42 NormalFactor = 1.000000 >03/25/14 14:25:42 MaxPrioValue = 0.987846 >03/25/14 14:25:42 NumSubmitterAds = 1 >03/25/14 14:25:42 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:25:42 0 seconds so far >03/25/14 14:25:42 Calculating submitter limit with the following parameters >03/25/14 14:25:42 SubmitterPrio = 0.987846 >03/25/14 14:25:42 SubmitterPrioFactor = 1.000000 >03/25/14 14:25:42 submitterShare = 1.000000 >03/25/14 14:25:42 submitterAbsShare = 1.000000 >03/25/14 14:25:42 submitterLimit = 0.000000 >03/25/14 14:25:42 submitterUsage = 30.000000 >03/25/14 14:25:42 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:25:42 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00011: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: large.test is 13.000000 >03/25/14 14:25:42 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:25:42 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00025: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:25:42 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:42 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00042: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: small.test is 2.000000 >03/25/14 14:25:42 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:25:42 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00063: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: test is 3.000000 >03/25/14 14:25:42 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:25:42 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00081: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:25:42 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:42 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00101: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: undef is 1.000000 >03/25/14 14:25:42 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:25:42 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got JOB_INFO command; getting classad/eom >03/25/14 14:25:42 Request 00001.00125: >03/25/14 14:25:42 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:25:42 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:25:42 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:25:42 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:25:42 Sending SEND_JOB_INFO/eom >03/25/14 14:25:42 Getting reply from schedd ... >03/25/14 14:25:42 Got NO_MORE_JOBS; done negotiating >03/25/14 14:25:42 This submitter hit its submitterLimit. >03/25/14 14:25:42 resources used scheddUsed= 30.000000 >03/25/14 14:25:42 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:25:42 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:25:42 Getting monitoring info for pid 22893 >03/25/14 14:25:43 Getting monitoring info for pid 22893 >03/25/14 14:25:44 Getting monitoring info for pid 22893 >03/25/14 14:25:45 Getting monitoring info for pid 22893 >03/25/14 14:25:46 Getting monitoring info for pid 22893 >03/25/14 14:25:47 Getting monitoring info for pid 22893 >03/25/14 14:25:48 Getting monitoring info for pid 22893 >03/25/14 14:25:49 Getting monitoring info for pid 22893 >03/25/14 14:25:50 Getting monitoring info for pid 22893 >03/25/14 14:25:51 Getting monitoring info for pid 22893 >03/25/14 14:25:52 Getting monitoring info for pid 22893 >03/25/14 14:25:53 Getting monitoring info for pid 22893 >03/25/14 14:25:54 Getting monitoring info for pid 22893 >03/25/14 14:25:55 Getting monitoring info for pid 22893 >03/25/14 14:25:56 Getting monitoring info for pid 22893 >03/25/14 14:25:57 Getting monitoring info for pid 22893 >03/25/14 14:25:58 Getting monitoring info for pid 22893 >03/25/14 14:25:59 Getting monitoring info for pid 22893 >03/25/14 14:26:00 Getting monitoring info for pid 22893 >03/25/14 14:26:01 Getting monitoring info for pid 22893 >03/25/14 14:26:02 ---------- Started Negotiation Cycle ---------- >03/25/14 14:26:02 Phase 1: Obtaining ads from collector ... >03/25/14 14:26:02 Getting Scheduler, Submitter and Machine ads ... >03/25/14 14:26:02 Trying to query collector <IP:9618> >03/25/14 14:26:02 Sorting 32 ads ... >03/25/14 14:26:02 Getting startd private ads ... >03/25/14 14:26:02 Trying to query collector <IP:9618> >03/25/14 14:26:02 Got ads: 32 public and 30 private >03/25/14 14:26:02 Public ads include 1 submitter, 30 startd >03/25/14 14:26:02 Phase 2: Performing accounting ... >03/25/14 14:26:02 Entering compute_significant_attrs() >03/25/14 14:26:02 Leaving compute_significant_attrs() - result=JobUniverse,LastCheckpointPlatform,NumCkpts >03/25/14 14:26:02 (ACCOUNTANT) Updating priorities - AgingFactor= 1.000 , TimePassed=20 >03/25/14 14:26:02 CustomerName=Customer.<none> , Old Priority=0.988 , New Priority=0.993 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:26:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=62955.000 (unweighted 62955.000), BeginUsageTime=1395751882 >03/25/14 14:26:02 CustomerName=Customer.test@<hostname> , Old Priority=0.988 , New Priority=0.993 , ResourcesUsed=30 , WeightedResourcesUsed=30.000000 >03/25/14 14:26:02 RecentUsage= 30.000 (unweighted 30.000), UnchargedTime= 0.000 (unweighted 0), AccumulatedUsage=62955.000 (unweighted 62955.000), BeginUsageTime=1395751882 >03/25/14 14:26:02 (Accountant) Checking Matches >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot10@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot20@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot11@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot30@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot21@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot12@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot22@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot13@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot23@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot14@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot15@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot24@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot25@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot16@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot26@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot17@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot27@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot18@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot28@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot19@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot29@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot1@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot2@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot3@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot4@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot5@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot6@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot7@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot8@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Accountant::AddMatch - CustomerName=test@<hostname>, ResourceName=slot9@<hostname>@<IP:36601> >03/25/14 14:26:02 Match already existed! >03/25/14 14:26:02 Previous Limits -- >03/25/14 14:26:02 Limit: test = 3.000000 >03/25/14 14:26:02 Limit: small.test = 2.000000 >03/25/14 14:26:02 Limit: medium.test = 5.000000 >03/25/14 14:26:02 Limit: undef.test = 1.000000 >03/25/14 14:26:02 Limit: undef = 1.000000 >03/25/14 14:26:02 Limit: large.test = 13.000000 >03/25/14 14:26:02 Limit: medium.undef = 5.000000 >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(medium.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(medium.undef) >03/25/14 14:26:02 IncrementLimit(small.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(medium.undef) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(medium.undef) >03/25/14 14:26:02 IncrementLimit(medium.undef) >03/25/14 14:26:02 IncrementLimit(medium.undef) >03/25/14 14:26:02 IncrementLimit(small.test) >03/25/14 14:26:02 IncrementLimit(test) >03/25/14 14:26:02 IncrementLimit(medium.test) >03/25/14 14:26:02 IncrementLimit(test) >03/25/14 14:26:02 IncrementLimit(medium.test) >03/25/14 14:26:02 IncrementLimit(test) >03/25/14 14:26:02 IncrementLimit(medium.test) >03/25/14 14:26:02 IncrementLimit(undef.test) >03/25/14 14:26:02 IncrementLimit(medium.test) >03/25/14 14:26:02 IncrementLimit(undef) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 IncrementLimit(large.test) >03/25/14 14:26:02 Current Limits -- >03/25/14 14:26:02 Limit: test = 3.000000 >03/25/14 14:26:02 Limit: small.test = 2.000000 >03/25/14 14:26:02 Limit: medium.test = 5.000000 >03/25/14 14:26:02 Limit: undef.test = 1.000000 >03/25/14 14:26:02 Limit: undef = 1.000000 >03/25/14 14:26:02 Limit: large.test = 13.000000 >03/25/14 14:26:02 Limit: medium.undef = 5.000000 >03/25/14 14:26:02 Phase 3: Sorting submitter ads by priority ... >03/25/14 14:26:02 Phase 4.1: Negotiating with schedds ... >03/25/14 14:26:02 numSlots = 30 >03/25/14 14:26:02 slotWeightTotal = 30.000000 >03/25/14 14:26:02 pieLeft = 0.000 >03/25/14 14:26:02 NormalFactor = 1.000000 >03/25/14 14:26:02 MaxPrioValue = 0.992501 >03/25/14 14:26:02 NumSubmitterAds = 1 >03/25/14 14:26:02 Negotiating with test@<hostname> at <IP:43885> >03/25/14 14:26:02 0 seconds so far >03/25/14 14:26:02 Calculating submitter limit with the following parameters >03/25/14 14:26:02 SubmitterPrio = 0.992501 >03/25/14 14:26:02 SubmitterPrioFactor = 1.000000 >03/25/14 14:26:02 submitterShare = 1.000000 >03/25/14 14:26:02 submitterAbsShare = 1.000000 >03/25/14 14:26:02 submitterLimit = 0.000000 >03/25/14 14:26:02 submitterUsage = 30.000000 >03/25/14 14:26:02 Socket to test@<hostname> (<IP:43885>) already in cache, reusing >03/25/14 14:26:02 Over submitter resource limit (0.000000, used 0.000000) ... only consider startd ranks >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00011: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: large.test is 13.000000 >03/25/14 14:26:02 Concurrency Limit large.test is 13.000000, requesting 1.000000, but cannot exceed 11.000000 >03/25/14 14:26:02 Rejected 1.11 test@<hostname> <IP:43885>: concurrency limit large.test reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00025: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: medium.test is 5.000000 >03/25/14 14:26:02 Concurrency Limit medium.test is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:26:02 Rejected 1.25 test@<hostname> <IP:43885>: concurrency limit medium.test reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00042: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: small.test is 2.000000 >03/25/14 14:26:02 Concurrency Limit small.test is 2.000000, requesting 1.000000, but cannot exceed 2.000000 >03/25/14 14:26:02 Rejected 1.42 test@<hostname> <IP:43885>: concurrency limit small.test reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00063: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: test is 3.000000 >03/25/14 14:26:02 Concurrency Limit test is 3.000000, requesting 1.000000, but cannot exceed 3.000000 >03/25/14 14:26:02 Rejected 1.63 test@<hostname> <IP:43885>: concurrency limit test reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00081: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: undef.test is 1.000000 >03/25/14 14:26:02 Concurrency Limit undef.test is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:26:02 Rejected 1.81 test@<hostname> <IP:43885>: concurrency limit undef.test reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00101: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: undef is 1.000000 >03/25/14 14:26:02 Concurrency Limit undef is 1.000000, requesting 1.000000, but cannot exceed 1.000000 >03/25/14 14:26:02 Rejected 1.101 test@<hostname> <IP:43885>: concurrency limit undef reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got JOB_INFO command; getting classad/eom >03/25/14 14:26:02 Request 00001.00125: >03/25/14 14:26:02 matchmakingAlgorithm: limit 0.000000 used 0.000000 pieLeft 0.000000 >03/25/14 14:26:02 Concurrency Limit: medium.undef is 5.000000 >03/25/14 14:26:02 Concurrency Limit medium.undef is 5.000000, requesting 1.000000, but cannot exceed 5.000000 >03/25/14 14:26:02 Rejected 1.125 test@<hostname> <IP:43885>: concurrency limit medium.undef reached >03/25/14 14:26:02 Sending SEND_JOB_INFO/eom >03/25/14 14:26:02 Getting reply from schedd ... >03/25/14 14:26:02 Got NO_MORE_JOBS; done negotiating >03/25/14 14:26:02 This submitter hit its submitterLimit. >03/25/14 14:26:02 resources used scheddUsed= 30.000000 >03/25/14 14:26:02 negotiateWithGroup resources used scheddAds length 1 >03/25/14 14:26:02 ---------- Finished Negotiation Cycle ---------- >03/25/14 14:26:02 Getting monitoring info for pid 22893 >03/25/14 14:26:03 Getting monitoring info for pid 22893 >03/25/14 14:26:04 Getting monitoring info for pid 22893 >03/25/14 14:26:05 Getting monitoring info for pid 22893 >03/25/14 14:26:06 Getting monitoring info for pid 22893 >03/25/14 14:26:07 Getting monitoring info for pid 22893 >03/25/14 14:26:08 Getting monitoring info for pid 22893 >03/25/14 14:26:09 Getting monitoring info for pid 22893 >03/25/14 14:26:10 Getting monitoring info for pid 22893 >03/25/14 14:26:11 Getting monitoring info for pid 22893 >03/25/14 14:26:12 Getting monitoring info for pid 22893 >03/25/14 14:26:13 Getting monitoring info for pid 22893 >03/25/14 14:26:14 Getting monitoring info for pid 22893 >03/25/14 14:26:15 Getting monitoring info for pid 22893
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1080491
: 878485