Bug 1934564 - Slow start of pipelines using jenkins sync plugin
Summary: Slow start of pipelines using jenkins sync plugin
Keywords:
Status: CLOSED DUPLICATE of bug 1925524
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Jenkins
Version: 4.6.z
Hardware: Unspecified
OS: Unspecified
medium
high
Target Milestone: ---
: 4.9.0
Assignee: Vibhav Bobade
QA Contact: Jitendar Singh
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-03-03 13:46 UTC by Sergio G.
Modified: 2024-12-20 19:42 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-07-19 14:20:35 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
sync log (95.79 KB, text/plain)
2021-03-03 13:46 UTC, Sergio G.
no flags Details

Description Sergio G. 2021-03-03 13:46:51 UTC
Created attachment 1760394 [details]
sync log

Description of problem:
Slow start of jobs in Jenkins after starting the build in OpenShift. 

The Global Concurrency Limit for Kubernetes is 100 on Jenkins Configure Clouds. There's no concurrency limitation on jenkins slave containers.

The slow is detected in some projects and not in others. Some projects builds always stay in "No stage have started." state for a long time while other projects are quickly triggered on Jenkins witout any issue.


Version-Release number of selected component (if applicable):
- OpenShift 4.6
- OpenShift Sync 1.0.45


How reproducible:
Always


Attaching an excerpt of the log (see full log attached):
2021-02-25 16:32:00 SEVERE  hudson.triggers.SafeTimerTask run Timer task io.fabric8.jenkins.openshiftsync.GlobalPluginConfigurationTimerTask@7d18fb7d failed
java.lang.IllegalArgumentException
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.scheduleAtFixedRate(ScheduledThreadPoolExecutor.java:623)
	at jenkins.util.InterceptingScheduledExecutorService.scheduleAtFixedRate(InterceptingScheduledExecutorService.java:59)
	at io.fabric8.jenkins.openshiftsync.BaseWatcher.start(BaseWatcher.java:63)
	at io.fabric8.jenkins.openshiftsync.ConfigMapWatcher.start(ConfigMapWatcher.java:93)
	at io.fabric8.jenkins.openshiftsync.GlobalPluginConfigurationTimerTask.intializeAndStartWatchers(GlobalPluginConfigurationTimerTask.java:55)
	at io.fabric8.jenkins.openshiftsync.GlobalPluginConfigurationTimerTask.doRun(GlobalPluginConfigurationTimerTask.java:40)
	at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:91)
	at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)

Comment 7 Akram Ben Aissi 2021-07-19 14:20:35 UTC
Marking this one as a duplicated of https://bugzilla.redhat.com/show_bug.cgi?id=1925524. 
This is getting fixed with the release of 1.0.47 of Jenkins plugin and subsequent versions which better manage scheduling of Tasks especially during high loads.

With OCP 4.5 and higher, this bug is likely to happen more frequently because of the introduction and enablement of the Priority and Fairness feature gate on OCP which limits and throttles the number of connections Jenkins can have to the API Server.

*** This bug has been marked as a duplicate of bug 1925524 ***


Note You need to log in before you can comment on or make changes to this bug.