Attachment 947398 Details for Bug 1152154 – agent log with log wait

agent log with log wait

agent_with_long_wait.log (text/plain), 31.54 KB, created by Viet Nguyen on 2014-10-16 03:05:58 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Viet Nguyen

Created: 2014-10-16 03:05:58 UTC

Size: 31.54 KB

patch

obsolete

>2014-10-16 02:46:14,351 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.java-logging-start}Reconfiguring Java Logging...
>2014-10-16 02:46:14,361 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.java-logging-done}Done reconfiguring Java Logging.
>2014-10-16 02:46:14,365 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.creating-agent}Agent being created now
>2014-10-16 02:46:14,423 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.loading-config-file}Loading configuration file [agent-configuration.xml]
>2014-10-16 02:46:16,589 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.loaded-config-file}Configuration file loaded [agent-configuration.xml]
>2014-10-16 02:46:16,596 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.preferences-schema}Preferences configuration schema: [9]
>2014-10-16 02:46:16,596 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.preferences-node-path}Preferences node path where configuration is persisted: [/rhq-agent/default]
>2014-10-16 02:46:16,612 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.configuration}Agent configuration: /rhq-agent/default[rhq.agent.agent-update.enabled=true,rhq.agent.client.command-preprocessors=org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor:org.rhq.enterprise.agent.ExternalizableStrategyCommandPreprocessor,rhq.agent.client.command-spool-file.compressed=true,rhq.agent.client.command-spool-file.name=command-spool.dat,rhq.agent.client.command-spool-file.params=10000000:75,rhq.agent.client.command-timeout-msecs=600000,rhq.agent.client.max-concurrent=5,rhq.agent.client.max-retries=10,rhq.agent.client.queue-size=50000,rhq.agent.client.queue-throttling=200:2000,rhq.agent.client.retry-interval-msecs=15000,rhq.agent.client.send-throttling=100:1000,rhq.agent.client.server-polling-interval-msecs=60000,rhq.agent.configuration-schema-version=9,rhq.agent.data-directory=data,rhq.agent.disable-native-system=false,rhq.agent.plugins.directory=plugins,rhq.agent.primary-server-switchover-check-interval-msecs=3600000,rhq.agent.register-with-server-at-startup=true,rhq.agent.server-auto-detection=false,rhq.agent.server.alias=rhqserver,rhq.agent.server.bind-port=7080,rhq.agent.server.transport=servlet,rhq.agent.server.transport-params=/jboss-remoting-servlet-invoker/ServerInvokerServlet,rhq.agent.test-failover-list-at-startup=true,rhq.agent.update-plugins-at-startup=true,rhq.agent.vm-health-check.interval-msecs=5000,rhq.agent.vm-health-check.low-heap-mem-threshold=0.90,rhq.agent.vm-health-check.low-nonheap-mem-threshold=0.90,rhq.agent.wait-for-server-at-startup-msecs=36000000,rhq.communications.command-authenticator=org.rhq.enterprise.agent.SecurityTokenCommandAuthenticator,rhq.communications.command-service-directory.allow-dynamic-discovery=true,rhq.communications.command-services=org.rhq.enterprise.communications.command.impl.echo.server.EchoCommandService, org.rhq.enterprise.communications.command.impl.identify.server.IdentifyCommandService,rhq.communications.configuration-schema-version=1,rhq.communications.connector.bind-port=16163,rhq.communications.connector.rhqtype=agent,rhq.communications.connector.transport=socket,rhq.communications.data-directory=data,rhq.communications.global-concurrency-limit=-1,rhq.communications.multicast-detector.bind-address=0.0.0.0,rhq.communications.multicast-detector.default-time-delay=5000,rhq.communications.multicast-detector.enabled=false,rhq.communications.multicast-detector.heartbeat-time-delay=1000,rhq.communications.multicast-detector.multicast-address=224.16.16.16,rhq.communications.multicast-detector.port=16162,rhq.communications.remote-pojos=org.rhq.enterprise.communications.PingImpl:org.rhq.enterprise.communications.Ping,rhq.communications.remote-stream-max-idle-time-msecs=300000]
>2014-10-16 02:46:16,627 DEBUG [main] (enterprise.communications.util.prefs.PreferencesUpgrade)- {PreferencesUpgrade.already-uptodate}The preferences configuration [rhq.agent.configuration-schema-version] is up-to-date at version [9]
>2014-10-16 02:46:16,628 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.args-processed}Agent container has processed its command line arguments: [--daemon]
>2014-10-16 02:46:16,781 INFO  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.identify-version}Version=[RHQ 4.12.0.JON330ER03], Build Number=[44e33a4], Build Date=[Sep 16, 2014 6:23 PM]
>2014-10-16 02:46:16,802 INFO  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.agent-name-auto-generated}The name of this agent was not predefined so it was auto-generated. The agent name is now [ae4a82a59bb9]
>2014-10-16 02:46:16,804 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentConfiguration.cert-file-location}Explicitly setting file location [rhq.communications.connector.security.keystore.file] to [/opt/rhq-agent/conf/keystore.dat]
>2014-10-16 02:46:16,804 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentConfiguration.cert-file-location}Explicitly setting file location [rhq.communications.connector.security.truststore.file] to [/opt/rhq-agent/conf/truststore.dat]
>2014-10-16 02:46:16,804 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentConfiguration.cert-file-location}Explicitly setting file location [rhq.agent.client.security.keystore.file] to [/opt/rhq-agent/conf/keystore.dat]
>2014-10-16 02:46:16,804 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentConfiguration.cert-file-location}Explicitly setting file location [rhq.agent.client.security.truststore.file] to [/opt/rhq-agent/conf/truststore.dat]
>2014-10-16 02:46:16,854 DEBUG [main] (org.rhq.enterprise.agent.AgentConfiguration)- {AgentConfiguration.server-alias-unknown}The configured server alias [rhqserver] cannot be resolved - will use localhost address. Cause: java.net.UnknownHostException: rhqserver
>2014-10-16 02:46:16,878 DEBUG [main] (org.jboss.logging)- Logging Provider: org.jboss.logging.Log4jLoggerProvider
>2014-10-16 02:46:16,881 DEBUG [main] (org.jboss.remoting)- Remoting version: 2.5.4.SP5 (Flounder)
>2014-10-16 02:46:16,890 DEBUG [main] (enterprise.communications.command.client.CommandQueue)- {CommandQueue.configured}Queue throttling is configured for [200] max commands in burst periods of [2,000] milliseconds.  These will take effect when queue throttling is enabled.
>2014-10-16 02:46:16,891 DEBUG [main] (enterprise.communications.command.client.CommandQueue)- {CommandQueue.enabled}Command Queue is now throttling - a maximum of [200] commands are allowed to be dequeued every [2,000] milliseconds
>2014-10-16 02:46:16,893 DEBUG [main] (enterprise.communications.command.client.SendThrottle)- {SendThrottle.configured}Send throttling is configured for [100] max commands and quiet periods of [1,000] milliseconds. These will take effect while send throttling is enabled.
>2014-10-16 02:46:16,895 DEBUG [main] (enterprise.communications.command.client.SendThrottle)- {SendThrottle.enabled}Send throttling is now enabled - a maximum of [100] commands are allowed to be sent in between quiet periods of [1,000] milliseconds.
>2014-10-16 02:46:16,911 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.added-state-listener}Added the command client sender state listener [org.rhq.enterprise.agent.AgentMain$CommandListenerStateListener@5ae79fbc]; sender is sending=[false]; notify listener immediately=[true]
>2014-10-16 02:46:16,913 DEBUG [main] (enterprise.communications.util.prefs.PreferencesUpgrade)- {PreferencesUpgrade.already-uptodate}The preferences configuration [rhq.communications.configuration-schema-version] is up-to-date at version [1]
>2014-10-16 02:46:16,914 INFO  [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.global-concurrency-limit-disabled}Global concurrency limit has been disabled - there is no limit to the number of incoming commands allowed
>2014-10-16 02:46:16,975 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.using-existing-mbs}Found an existing MBeanServer [DefaultDomain] - will use that
>2014-10-16 02:46:17,067 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.registry-created}Network registry has been created [rhq.remoting:type=networkregistry]
>2014-10-16 02:46:17,067 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.multicast-detector-disabled}Multicast detector has not been enabled in configuration - it will not be started and auto-discovery will not be supported
>2014-10-16 02:46:17,071 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.added-command-service}Added command service [org.rhq.enterprise.communications.command.impl.echo.server.EchoCommandService] with an id of [1]
>2014-10-16 02:46:17,083 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.added-command-service}Added command service [org.rhq.enterprise.communications.command.impl.identify.server.IdentifyCommandService] with an id of [2]
>2014-10-16 02:46:17,086 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.added-command-service}Added command service [org.rhq.enterprise.communications.command.impl.remotepojo.server.RemotePojoInvocationCommandService] with an id of [3]
>2014-10-16 02:46:17,087 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.added-remote-pojo}Added remote POJO of type [org.rhq.enterprise.communications.PingImpl] with a remote interface of [org.rhq.enterprise.communications.Ping]
>2014-10-16 02:46:17,089 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.dynamic-discovery-allowed}Command Service Directory has been allowed to perform dynamic discovery
>2014-10-16 02:46:17,125 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.new-supported-command}Command [echo] is now supported by [rhq.remoting:type=command,subsystem=RHQ,id=1]
>2014-10-16 02:46:17,126 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.new-supported-command}Command [identify] is now supported by [rhq.remoting:type=command,subsystem=RHQ,id=2]
>2014-10-16 02:46:17,128 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.new-supported-command}Command [remotepojo] is now supported by [rhq.remoting:type=command,subsystem=RHQ,id=3]
>2014-10-16 02:46:17,128 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.directory-created}Command service directory has been created [rhq.remoting:type=directory]
>2014-10-16 02:46:17,137 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.connector-uri}Connector is using locator URI of [InvokerLocator [socket://172.17.0.241:16163/?backlog=200&clientMaxPoolSize=304&enableTcpNoDelay=true&maxPoolSize=303&numAcceptThreads=1&rhq.communications.connector.rhqtype=agent&socketTimeout=60000]]
>2014-10-16 02:46:17,142 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.connector-lease-period}The connector lease period is [-1]
>2014-10-16 02:46:17,247 DEBUG [main] (org.jboss.remoting.ServerInvoker)- SocketServerInvoker[172.17.0.241:16163] did not find server socket factory configuration as mbean service or classname. Creating default server socket factory.
>2014-10-16 02:46:17,247 DEBUG [main] (org.jboss.remoting.ServerInvoker)- SocketServerInvoker[172.17.0.241:16163] created server socket factory javax.net.DefaultServerSocketFactory@2a7655aa
>2014-10-16 02:46:17,266 DEBUG [main] (enterprise.communications.command.server.CommandProcessor)- {CommandProcessor.authenticator-set}Command processor assigned an authenticator for command security checks: [org.rhq.enterprise.agent.SecurityTokenCommandAuthenticator@59b15c87]
>2014-10-16 02:46:17,267 DEBUG [main] (org.jboss.remoting.ServerInvoker)- SocketServerInvoker[172.17.0.241:16163] added org.rhq.enterprise.communications.command.server.CommandProcessor@16d58d32 for subsystem 'RHQ'
>2014-10-16 02:46:17,267 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] starting
>2014-10-16 02:46:17,271 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] created ServerSocket[addr=/172.17.0.241,localport=16163]
>2014-10-16 02:46:17,273 DEBUG [main] (org.jboss.remoting.ServerInvoker)- SocketServerInvoker[172.17.0.241:16163] started for locator InvokerLocator [socket://172.17.0.241:16163/?backlog=200&clientMaxPoolSize=304&enableTcpNoDelay=true&maxPoolSize=303&numAcceptThreads=1&rhq.communications.connector.rhqtype=agent&socketTimeout=60000]
>2014-10-16 02:46:17,306 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] started
>2014-10-16 02:46:17,306 DEBUG [main] (org.jboss.remoting.transport.Connector)- org.jboss.remoting.transport.Connector@14aad613 started
>2014-10-16 02:46:17,309 DEBUG [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.processor-ready}Command processor is now ready to begin accepting commands from clients
>2014-10-16 02:46:17,309 INFO  [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.started}Service container started - ready to accept incoming commands
>2014-10-16 02:46:17,309 INFO  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.no-auto-detect}Server auto-detection is not enabled - starting the poller immediately
>2014-10-16 02:46:17,325 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.added-state-listener}Added the command client sender state listener [org.rhq.enterprise.agent.AgentMain$RegisterStateListener@12aed009]; sender is sending=[false]; notify listener immediately=[true]
>2014-10-16 02:46:17,325 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.started}Server polling thread has started and will poll for server status every [60,000] milliseconds
>2014-10-16 02:46:17,326 DEBUG [RHQ Server Polling Thread] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:46:17,326 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.added-state-listener}Added the command client sender state listener [org.rhq.enterprise.agent.AgentMain$PluginContainerConditionalRestartListener@597e9be9]; sender is sending=[false]; notify listener immediately=[false]
>2014-10-16 02:46:17,327 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.waiting-for-server}The agent is waiting for the server - will sleep for [36,000,000] milliseconds
>2014-10-16 02:46:17,327 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.added-state-listener}Added the command client sender state listener [org.rhq.enterprise.agent.AgentMain$2@5f05c0eb]; sender is sending=[false]; notify listener immediately=[true]
>2014-10-16 02:46:17,331 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:46:17,338 DEBUG [RHQ Server Polling Thread] (org.jboss.remoting.Client)- Client[2034102783:4sh06p-dejz1v-i1biaagy-1-i1biaaka-3].connect(null)
>2014-10-16 02:46:17,365 DEBUG [RHQ Server Polling Thread] (org.jboss.remoting.MicroRemoteClientInvoker)- org.jboss.remoting.transport.http.HTTPClientInvoker@604fb7e9 connecting
>2014-10-16 02:46:17,365 DEBUG [RHQ Server Polling Thread] (org.jboss.remoting.MicroRemoteClientInvoker)- org.jboss.remoting.transport.http.HTTPClientInvoker@604fb7e9 connected
>2014-10-16 02:46:17,366 DEBUG [RHQ Server Polling Thread] (org.jboss.remoting.Client)- Client[2034102783:4sh06p-dejz1v-i1biaagy-1-i1biaaka-3] connected to InvokerLocator [servlet://172.17.0.241:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]
>2014-10-16 02:46:17,366 DEBUG [RHQ Server Polling Thread] (org.jboss.remoting.Client)- Client[2034102783:4sh06p-dejz1v-i1biaagy-1-i1biaaka-3] is connected
>2014-10-16 02:46:17,723 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-poll-failure}Failed to successfully poll the server. This is normally due to the server not being up yet. You can usually ignore this message since it will be tried again later, however, you should ensure this failure was not really caused by a misconfiguration. Cause: org.jboss.remoting.transport.http.WebServerError:<html><head><title>JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report</title><style></style> </head><body><h1>JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet</h1><HR size="1" noshade="noshade"><p><b>JBWEB000309: type</b> JBWEB000067: Status report</p><p><b>JBWEB000068: message</b> <u>/jboss-remoting-servlet-invoker/ServerInvokerServlet</u></p><p><b>JBWEB000069: description</b> <u>JBWEB000124: The requested resource is not available.</u></p><HR size="1" noshade="noshade"><h3>JBoss Web/7.4.8.Final-redhat-4</h3></body></html>
>2014-10-16 02:47:17,724 DEBUG [RHQ Server Polling Thread] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:47:17,724 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:48:17,744 DEBUG [RHQ Server Polling Thread] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:48:17,745 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:49:17,752 DEBUG [RHQ Server Polling Thread] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:49:17,752 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:49:17,826 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.loading-command-spool}Loading [0] commands from the spool file and queueing them up to be sent to [remoting endpoint [servlet://172.17.0.241:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]]
>2014-10-16 02:49:17,827 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.unspooled}[0] commands were unspooled and will be resent to [remoting endpoint [servlet://172.17.0.241:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]]
>2014-10-16 02:49:17,827 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.sending}Client is now going to actively send commands
>2014-10-16 02:49:17,827 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.notifying-state-listeners}Notifying command client sender state listeners of a state change - sender is sending=[true]
>2014-10-16 02:49:18,843 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.agent-registration-attempt}Agent will now attempt to register with the server [AgentRegistrationRequest: [name=[ae4a82a59bb9]; address=[172.17.0.241]; port=[16163]; remote-endpoint=[socket://172.17.0.241:16163/?rhq.communications.connector.rhqtype=agent&numAcceptThreads=1&maxPoolSize=303&clientMaxPoolSize=304&socketTimeout=60000&enableTcpNoDelay=true&backlog=200]; regenerate-token=[false]; original-token=[<was null>]; agent-version=[4.12.0.JON330ER03(44e33a4)]; install-id=[null]; install-location=[/opt/rhq-agent]]
>2014-10-16 02:49:18,846 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:49:18,850 DEBUG [ClientCommandSenderTask Timer Thread #0] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:49:19,096 DEBUG [WorkerThread#0[172.17.0.241:39575]] (enterprise.communications.command.server.CommandProcessor)- {CommandProcessor.executing}Executing command [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.send-throttle=true, rhq.timeout=10000}]; params=[{targetInterfaceName=org.rhq.enterprise.communications.Ping, invocation=NameBasedInvocation[ping]}]]
>2014-10-16 02:49:19,099 DEBUG [WorkerThread#0[172.17.0.241:39575]] (enterprise.communications.command.server.CommandProcessor)- {CommandProcessor.executed}Executed command - response is [Command Response: isSuccessful=[true]; command=[null]; results=[]; exception=[>> exception was null <<]]
>2014-10-16 02:49:19,107 DEBUG [WorkerThread#0[172.17.0.241:39575]] (jboss.remoting.transport.socket.ServerThread)- WorkerThread#0[172.17.0.241:39575] closed socketWrapper: ServerSocketWrapper[Socket[addr=/172.17.0.241,port=39575,localport=16163].7a960b08]
>2014-10-16 02:50:17,829 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.removed-state-listener}Removed the command client sender state listener [org.rhq.enterprise.agent.AgentMain$RegisterStateListener@12aed009]
>2014-10-16 02:50:17,845 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.removed-state-listener}Removed the command client sender state listener [org.rhq.enterprise.agent.AgentMain$2@5f05c0eb]
>2014-10-16 02:50:17,845 INFO  [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-online}The server has come back online; client has been told to start sending commands again
>2014-10-16 02:50:17,846 FATAL [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.startup-error}The agent encountered an error during startup and must abort
>org.rhq.core.clientapi.server.core.AgentRegistrationException: The agent cannot register with the server. Admin intervention needed!
>	at org.rhq.enterprise.agent.AgentMain.start(AgentMain.java:720)
>	at org.rhq.enterprise.agent.AgentMain.main(AgentMain.java:448)
>2014-10-16 02:50:17,848 INFO  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.shutting-down}Agent is being shut down...
>2014-10-16 02:50:17,848 INFO  [main] (org.rhq.core.pc.PluginContainer)- Plugin container is already shut down.
>2014-10-16 02:50:17,849 WARN  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failed-to-shutdown-component}Agent failed to shutdown component [Plugin Container]. Cause: java.lang.NullPointerException:null
>2014-10-16 02:50:17,849 DEBUG [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.notifying-server-of-shutdown}Agent is notifying the server that it is shutting down.
>2014-10-16 02:50:17,849 DEBUG [main] (org.rhq.enterprise.agent.SecurityTokenCommandPreprocessor)- {SecurityTokenCommandPreprocessor.no-security-token-yet}There is no security token yet - the server will not accept commands from this agent until the agent is registered.
>2014-10-16 02:50:17,850 DEBUG [ClientCommandSenderTask Timer Thread #1] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-done}The initialize callback has finished. Callback to be invoked again? [true]
>2014-10-16 02:50:17,865 DEBUG [main] (enterprise.communications.command.client.ClientRemotePojoFactory)- {ClientRemotePojoFactory.execution-failure}Failed to execute remote POJO method [agentIsShuttingDown]. Cause: org.rhq.enterprise.communications.command.server.AuthenticationException:Command failed to be authenticated!  This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=ae4a82a59bb9, rhq.externalizable-strategy=AGENT, rhq.timeout=10000}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[agentIsShuttingDown]}]
>2014-10-16 02:50:17,865 WARN  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-shutdown-notification-failure}Agent failed to notify the server of the pending shutdown. Cause: org.rhq.enterprise.communications.command.server.AuthenticationException:Command failed to be authenticated!  This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=ae4a82a59bb9, rhq.externalizable-strategy=AGENT, rhq.timeout=10000}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[agentIsShuttingDown]}]
>2014-10-16 02:50:17,866 DEBUG [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.stopped}Server polling thread has been stopped
>2014-10-16 02:50:38,483 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.test-failover-list-entry}Testing failover connectivity to server [10.16.23.108:49305]
>2014-10-16 02:50:38,484 DEBUG [main] (org.jboss.remoting.InvokerRegistry)- removed org.jboss.remoting.transport.http.HTTPClientInvoker@604fb7e9 from registry
>2014-10-16 02:50:38,484 DEBUG [main] (org.jboss.remoting.Client)- Client[2034102783:4sh06p-dejz1v-i1biaagy-1-i1biaaka-3] is disconnected
>2014-10-16 02:50:38,484 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.spooling}Persisting commands with guaranteed delivery to the spool file
>2014-10-16 02:50:38,485 INFO  [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.agent-registration-results}Agent has successfully registered with the server. The results are: [AgentRegistrationResults: [agent-token=a8VtCuU5ugfJT/BVxQkMXaCElwQ2jCRZCVV23akvj+cPz4O6yjdb94WcK+N5Ws+DToI=]]
>2014-10-16 02:50:38,486 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.spool-done}Persisted [0] commands to the spool file for later delivery to [remoting endpoint [servlet://172.17.0.241:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]]; [0] volatile commands remain in the queue and will be lost if the sender does not start again
>2014-10-16 02:50:38,486 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.no-longer-sending}Client is no longer actively sending commands to [remoting endpoint [servlet://172.17.0.241:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]]
>2014-10-16 02:50:38,486 DEBUG [main] (enterprise.communications.command.client.ClientCommandSender)- {ClientCommandSender.notifying-state-listeners}Notifying command client sender state listeners of a state change - sender is sending=[false]
>2014-10-16 02:50:38,486 DEBUG [main] (enterprise.communications.command.client.CommandQueue)- {CommandQueue.disabled}Command Queue is not throttling - commands will be dequeued as fast as possible
>2014-10-16 02:50:38,486 DEBUG [main] (enterprise.communications.command.client.SendThrottle)- {SendThrottle.disabled}Send throttling is disabled - commands will be sent as fast as possible
>2014-10-16 02:50:38,486 INFO  [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.shutting-down}Service container shutting down...
>2014-10-16 02:50:38,487 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] stopped threads in clientpool
>2014-10-16 02:50:38,487 DEBUG [ServerSocketRefresh] (jboss.remoting.transport.socket.SocketServerInvoker)- ServerSocketRefresh shutting down
>2014-10-16 02:50:38,488 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] stopped threads in threadpool
>2014-10-16 02:50:38,488 DEBUG [main] (jboss.remoting.transport.socket.SocketServerInvoker)- SocketServerInvoker[172.17.0.241:16163] exiting
>2014-10-16 02:50:38,490 DEBUG [main] (org.jboss.remoting.ServerInvoker)- SocketServerInvoker[172.17.0.241:16163] stopped
>2014-10-16 02:50:38,491 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.removed-command-support}Command [echo] is no longer supported; removed [rhq.remoting:type=command,subsystem=RHQ,id=1]
>2014-10-16 02:50:38,492 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.removed-command-support}Command [identify] is no longer supported; removed [rhq.remoting:type=command,subsystem=RHQ,id=2]
>2014-10-16 02:50:38,492 DEBUG [main] (enterprise.communications.command.server.CommandServiceDirectory)- {CommandServiceDirectory.removed-command-support}Command [remotepojo] is no longer supported; removed [rhq.remoting:type=command,subsystem=RHQ,id=3]
>2014-10-16 02:50:38,492 INFO  [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.shutdown}Service container shut down - no longer accepting incoming commands
>2014-10-16 02:50:38,492 INFO  [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.shut-down}Agent has been shut down
>2014-10-16 02:50:38,493 FATAL [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.start-failure}Failed to start the agent
>org.rhq.core.clientapi.server.core.AgentRegistrationException: The agent cannot register with the server. Admin intervention needed!
>	at org.rhq.enterprise.agent.AgentMain.start(AgentMain.java:720)
>	at org.rhq.enterprise.agent.AgentMain.main(AgentMain.java:448)
>2014-10-16 02:50:38,493 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {SecurityTokenCommandPreprocessor.new-security-token}A new security token has been persisted: a8VtCuU5ugfJT/BVxQkMXaCElwQ2jCRZCVV23akvj+cPz4O6yjdb94WcK+N5Ws+DToI=
>2014-10-16 02:50:38,493 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-list-persisted}The server failover list has been persisted to [data/failover-list.dat]
>2014-10-16 02:50:38,495 DEBUG [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentConfiguration)- {AgentConfiguration.server-alias-unknown}The configured server alias [rhqserver] cannot be resolved - will use localhost address. Cause: java.net.UnknownHostException: rhqserver

Actions: View

Attachments on bug 1152154: 947398