Bug 1868069 - jenkins 4.6 image crashes on startup: missing proxy.yaml
Summary: jenkins 4.6 image crashes on startup: missing proxy.yaml
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Jenkins
Version: 4.6
Hardware: All
OS: All
unspecified
high
Target Milestone: ---
: 4.6.0
Assignee: Akram Ben Aissi
QA Contact: Jitendar Singh
URL:
Whiteboard:
: 1868250 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-08-11 15:00 UTC by Jitendar Singh
Modified: 2020-10-27 16:27 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-27 16:27:31 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift jenkins pull 1134 0 None closed [head] Bug 1868069: Fix missing proxy.yaml 2021-02-15 15:15:19 UTC
Red Hat Product Errata RHBA-2020:4196 0 None None None 2020-10-27 16:27:50 UTC

Description Jitendar Singh 2020-08-11 15:00:41 UTC
Description of problem:
When the user runs the "oc new-app jenkins-ephemeral" or oc new-app jenkins-persistent" command to use the operator on openshift. The jenkins pod doesnt come up to READY state, The deployment pod runs and after 600 secs the jenkins pod and the deployment config pod crahes.



Version-Release number of selected component (if applicable): 4.6


How reproducible:
oc new-project jenkins-test
oc new-app jenkins-ephemeral // oc new-app jenkins-persistent(need a PV in the cluster)


Steps to Reproduce:
1.Login to openshift cluster on terminal<oc login <url> -u <user> -p <pwd>
2.oc new-project <project name>
3.oc new-app jenkins-ephemeral OR oc new-app jenkins-persistent(need a PV in the cluster)

Actual results:
The deployment pod comes up but the jenkins operator pod crahes. Below are the logs.
================================================================================

2020-08-11 05:48:20 SEVERE  jenkins.InitReactorRunner$1 onTaskFailed Failed ConfigurationAsCode.init
java.lang.Error: java.lang.reflect.InvocationTargetException
	at hudson.init.TaskMethodFinder.invoke(TaskMethodFinder.java:110)
	at hudson.init.TaskMethodFinder$TaskImpl.run(TaskMethodFinder.java:175)
	at org.jvnet.hudson.reactor.Reactor.runTask(Reactor.java:296)
	at jenkins.model.Jenkins$5.runTask(Jenkins.java:1131)
	at org.jvnet.hudson.reactor.Reactor$2.run(Reactor.java:214)
	at org.jvnet.hudson.reactor.Reactor$Node.run(Reactor.java:117)
	at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.reflect.InvocationTargetException
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at hudson.init.TaskMethodFinder.invoke(TaskMethodFinder.java:104)
	... 9 more
Caused by: io.jenkins.plugins.casc.ConfiguratorException: Invalid configuration: '/var/lib/jenkins/proxy.yaml' isn't a valid path.
	at io.jenkins.plugins.casc.ConfigurationAsCode.configs(ConfigurationAsCode.java:643)
	at io.jenkins.plugins.casc.ConfigurationAsCode.appendSources(ConfigurationAsCode.java:263)
	at io.jenkins.plugins.casc.ConfigurationAsCode.getStandardConfigSources(ConfigurationAsCode.java:306)
	at io.jenkins.plugins.casc.ConfigurationAsCode.configure(ConfigurationAsCode.java:298)
	at io.jenkins.plugins.casc.ConfigurationAsCode.init(ConfigurationAsCode.java:290)
	... 14 more
2020-08-11 05:48:20 SEVERE  hudson.util.BootFailure publish Failed to initialize Jenkins
hudson.util.HudsonFailedToLoad: org.jvnet.hudson.reactor.ReactorException: java.lang.Error: java.lang.reflect.InvocationTargetException
	at hudson.WebAppMain$3.run(WebAppMain.java:279)
Caused by: org.jvnet.hudson.reactor.ReactorException: java.lang.Error: java.lang.reflect.InvocationTargetException
	at org.jvnet.hudson.reactor.Reactor.execute(Reactor.java:282)
	at jenkins.InitReactorRunner.run(InitReactorRunner.java:50)
	at jenkins.model.Jenkins.executeReactor(Jenkins.java:1164)
	at jenkins.model.Jenkins.<init>(Jenkins.java:964)
	at hudson.model.Hudson.<init>(Hudson.java:85)
	at hudson.model.Hudson.<init>(Hudson.java:81)
	at hudson.WebAppMain$3.run(WebAppMain.java:262)
Caused by: java.lang.Error: java.lang.reflect.InvocationTargetException
	at hudson.init.TaskMethodFinder.invoke(TaskMethodFinder.java:110)
	at hudson.init.TaskMethodFinder$TaskImpl.run(TaskMethodFinder.java:175)
	at org.jvnet.hudson.reactor.Reactor.runTask(Reactor.java:296)
	at jenkins.model.Jenkins$5.runTask(Jenkins.java:1131)
	at org.jvnet.hudson.reactor.Reactor$2.run(Reactor.java:214)
	at org.jvnet.hudson.reactor.Reactor$Node.run(Reactor.java:117)
	at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.reflect.InvocationTargetException
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at hudson.init.TaskMethodFinder.invoke(TaskMethodFinder.java:104)
	... 9 more
Caused by: io.jenkins.plugins.casc.ConfiguratorException: Invalid configuration: '/var/lib/jenkins/proxy.yaml' isn't a valid path.
	at io.jenkins.plugins.casc.ConfigurationAsCode.configs(ConfigurationAsCode.java:643)
	at io.jenkins.plugins.casc.ConfigurationAsCode.appendSources(ConfigurationAsCode.java:263)
	at io.jenkins.plugins.casc.ConfigurationAsCode.getStandardConfigSources(ConfigurationAsCode.java:306)
	at io.jenkins.plugins.casc.ConfigurationAsCode.configure(ConfigurationAsCode.java:298)
	at io.jenkins.plugins.casc.ConfigurationAsCode.init(ConfigurationAsCode.java:290)
	... 14 more
2020-08-11 05:48:20 WARNING hudson.model.ComputerSet <clinit> Failed to instantiate NodeMonitors
java.nio.channels.ClosedByInterruptException
	at java.base/java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199)
	at java.base/sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:162)
	at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:285)
	at hudson.util.FileChannelWriter.write(FileChannelWriter.java:73)
	at java.base/java.io.Writer.write(Writer.java:290)
	at hudson.util.AtomicFileWriter.write(AtomicFileWriter.java:162)
	at java.base/java.io.Writer.write(Writer.java:249)
	at hudson.XmlFile.write(XmlFile.java:191)
	at hudson.model.ComputerSet$1.save(ComputerSet.java:83)
	at hudson.util.PersistedList.onModified(PersistedList.java:173)
	at hudson.util.PersistedList.replaceBy(PersistedList.java:85)
	at hudson.model.ComputerSet.<clinit>(ComputerSet.java:461)
	at jenkins.metrics.impl.JenkinsHealthCheckProviderImpl.getHealthChecks(JenkinsHealthCheckProviderImpl.java:89)
	at jenkins.metrics.api.HealthCheckProviderListener.onChange(HealthCheckProviderListener.java:93)
	at jenkins.metrics.api.HealthCheckProviderListener.attach(HealthCheckProviderListener.java:79)
	at jenkins.metrics.api.Metrics.afterExtensionsAugmented(Metrics.java:314)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at hudson.init.TaskMethodFinder.invoke(TaskMethodFinder.java:104)
	at hudson.init.TaskMethodFinder$TaskImpl.run(TaskMethodFinder.java:175)
	at org.jvnet.hudson.reactor.Reactor.runTask(Reactor.java:296)
	at jenkins.model.Jenkins$5.runTask(Jenkins.java:1131)
	at org.jvnet.hudson.reactor.Reactor$2.run(Reactor.java:214)
	at org.jvnet.hudson.reactor.Reactor$Node.run(Reactor.java:117)
	at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins cleanUp Stopping Jenkins
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins$18 onAttained Started termination
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins$18 onAttained Completed termination
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins _cleanUpDisconnectComputers Starting node disconnection
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins _cleanUpShutdownPluginManager Stopping plugin manager
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins _cleanUpPersistQueue Persisting build queue
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins _cleanUpAwaitDisconnects Waiting for node disconnection completion
2020-08-11 05:48:20 INFO    jenkins.model.Jenkins cleanUp Jenkins stopped
================================================================================


Expected results:
The operator pod should come up and all the necessary resources must be created and the jenkins route should be available.


Additional info:

Comment 1 Jitendar Singh 2020-08-12 06:44:56 UTC
*** Bug 1868250 has been marked as a duplicate of this bug. ***

Comment 5 Jitendar Singh 2020-08-16 06:53:50 UTC
Pods coming up, able to login but pipeline build failing with hudson.plugins.git/hudson.PluginManager exception

Comment 6 Jitendar Singh 2020-08-19 06:59:27 UTC
VERIFIED
=============================================
 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc new-project jenkins-test
Now using project "jenkins-test" on server "https://api.jenkins-2020-08-18-165040.qe.devcluster.openshift.com:6443".

You can add applications to this project with the 'new-app' command. For example, try:

    oc new-app django-psql-example

to build a new example application in Python. Or use kubectl to deploy a simple Kubernetes application:

    kubectl create deployment hello-node --image=gcr.io/hello-minikube-zero-install/hello-node

 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc new-app jenkins-ephemeral
--> Deploying template "openshift/jenkins-ephemeral" to project jenkins-test

===============================================================================================================================
 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc new-app -f https://raw.githubusercontent.com/openshift/origin/master/examples/jenkins/pipeline/maven-pipeline.yaml
--> Deploying template "jenkins-test/maven-pipeline" for "https://raw.githubusercontent.com/openshift/origin/master/examples/jenkins/pipeline/maven-pipeline.yaml" to project jenkins-test

     * With parameters:
        * Application Name=openshift-jee-sample
        * Source URL=https://github.com/openshift/openshift-jee-sample.git
        * Source Ref=master
        * GitHub Webhook Secret=kI0QmrOr3wl7dbtS5fklYwqYToumnVCXXdaba4VH # generated
        * Generic Webhook Secret=rIPq7ah0BJkRFGFuLtRirgGq26Emunxx0o1sfTfB # generated

--> Creating resources ...
    imagestream.image.openshift.io "openshift-jee-sample" created
    imagestream.image.openshift.io "wildfly" created
    buildconfig.build.openshift.io "openshift-jee-sample" created
    buildconfig.build.openshift.io "openshift-jee-sample-docker" created
    deploymentconfig.apps.openshift.io "openshift-jee-sample" created
    service "openshift-jee-sample" created
    route.route.openshift.io "openshift-jee-sample" created
--> Success
    Use 'oc start-build openshift-jee-sample' to start a build.
    Use 'oc start-build openshift-jee-sample-docker' to start a build.
    Access your application via route 'openshift-jee-sample-jenkins-test.apps.jenkins-2020-08-18-165040.qe.devcluster.openshift.com' 
    Run 'oc status' to view your app.
 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc start-build openshift-jee-sample
build.build.openshift.io/openshift-jee-sample-1 started
 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc get pods
NAME               READY   STATUS      RESTARTS   AGE
jenkins-1-deploy   0/1     Completed   0          3m45s
jenkins-1-wjf9j    1/1     Running     0          3m41s
 jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc get pods -w
NAME               READY   STATUS      RESTARTS   AGE
jenkins-1-deploy   0/1     Completed   0          3m50s
jenkins-1-wjf9j    1/1     Running     0          3m46s
maven-gjqlp        0/1     Pending     0          0s
maven-gjqlp        0/1     Pending     0          0s
maven-gjqlp        0/1     ContainerCreating   0          0s
maven-gjqlp        0/1     ContainerCreating   0          2s
maven-gjqlp        0/1     ContainerCreating   0          6s
maven-gjqlp        1/1     Running             0          28s
maven-gjqlp        1/1     Terminating         0          56s
openshift-jee-sample-docker-1-build   0/1     Pending             0          0s
openshift-jee-sample-docker-1-build   0/1     Pending             0          0s
openshift-jee-sample-docker-1-build   0/1     Init:0/2            0          0s
maven-gjqlp                           0/1     Terminating         0          60s
openshift-jee-sample-docker-1-build   0/1     Init:0/2            0          2s
openshift-jee-sample-docker-1-build   0/1     Init:0/2            0          6s
maven-gjqlp                           0/1     Terminating         0          66s
maven-gjqlp                           0/1     Terminating         0          66s
openshift-jee-sample-docker-1-build   0/1     Init:0/2            0          11s
openshift-jee-sample-docker-1-build   0/1     Init:1/2            0          12s
openshift-jee-sample-docker-1-build   0/1     PodInitializing     0          13s
openshift-jee-sample-docker-1-build   1/1     Running             0          14s
openshift-jee-sample-docker-1-build   0/1     Completed           0          77s
openshift-jee-sample-1-deploy         0/1     Pending             0          0s
openshift-jee-sample-1-deploy         0/1     Pending             0          0s
openshift-jee-sample-1-deploy         0/1     ContainerCreating   0          0s
openshift-jee-sample-1-deploy         0/1     ContainerCreating   0          2s
openshift-jee-sample-1-76nq6          0/1     Pending             0          0s
openshift-jee-sample-1-76nq6          0/1     Pending             0          0s
openshift-jee-sample-1-76nq6          0/1     ContainerCreating   0          0s
openshift-jee-sample-1-deploy         1/1     Running             0          2s
openshift-jee-sample-1-76nq6          0/1     ContainerCreating   0          2s
openshift-jee-sample-1-76nq6          0/1     ContainerCreating   0          6s
openshift-jee-sample-1-76nq6          0/1     Running             0          37s

===================================================================================
jsingh@localhost  ~/Downloads/openshift-install-linux-4.6.0-0.nightly-2020-08-18-165040  oc get pods
NAME                                  READY   STATUS      RESTARTS   AGE
jenkins-1-deploy                      0/1     Completed   0          8m8s
jenkins-1-wjf9j                       1/1     Running     0          8m4s
openshift-jee-sample-1-76nq6          1/1     Running     0          112s
openshift-jee-sample-1-deploy         0/1     Completed   0          114s
openshift-jee-sample-docker-1-build   0/1     Completed   0          3m12s
===============================================================================
pipeline build succesful and dont see any SEVERE log in master pod

Comment 8 errata-xmlrpc 2020-10-27 16:27:31 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196


Note You need to log in before you can comment on or make changes to this bug.