We currently have concurrent: yes for most jobs, because if we didn't it wouldn't run two jobs simultaneously on multiple machines. While we want concurrency, we also do not want two jobs on the same machine. The key is to use this: http://docs.openstack.org/infra/jenkins-job-builder/properties.html#properties.slave-utilization
Done!