Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 900005 (JBPAPP6-407)

Summary: mod_cluster: All workers are in error state and MEM: MEM: Can't read node
Product: [JBoss] JBoss Enterprise Application Platform 6 Reporter: Michal Karm Babacek <mbabacek>
Component: mod_clusterAssignee: Michal Karm Babacek <mbabacek>
Status: CLOSED NEXTRELEASE QA Contact:
Severity: urgent Docs Contact:
Priority: urgent    
Version: 6.0.0CC: mbabacek
Target Milestone: ---   
Target Release: EAP 6.0.0   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/JBPAPP6-407
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
RHEL 6, x86_64
Last Closed: 2012-03-22 15:37:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
httpd-logs.zip
none
perf01-logs-and-config.zip none

Description Michal Karm Babacek 2012-03-09 09:22:08 UTC
project_key: JBPAPP6

The following setup on EAP6 servers:
{code:lang=xml}
<subsystem xmlns="urn:jboss:domain:modcluster:1.0">
     <mod-cluster-config advertise-socket="modcluster"/>
</subsystem>
{code}
results in 
{noformat}
[JBoss] 03:55:59,705 ERROR [org.jboss.modcluster.mcmp.impl.DefaultMCMPHandler] (ContainerBackgroundProcessor[StandardEngine[jboss.web]]) Error [MEM: MEM: Can't read node: {4}] sending command STATUS to proxy perf05.mw.lab.eng.bos.redhat.com/10.16.88.183:8888, configuration will be reset
[JBoss] 03:56:09,710 ERROR [org.apache.catalina.core.ContainerBase] (ContainerBackgroundProcessor[StandardEngine[jboss.web]]) Exception invoking periodic operation: : java.lang.IllegalArgumentException: Node: [3],Name: REMOVED,Balancer: qacluster,LBGroup: ,Host: perf03,Port: 8080,Type: http,Flushpackets: Off,Flushwait: 10,Ping: 10,Smax: 1,Ttl: 60,Elected: 1936,Read: 30992,Transfered: 573806,Connected: 0,Load: 1 [JBoss] Vhost: [2:1:1], Alias: example.com [JBoss] Vhost: [2:1:2], Alias: localhost [JBoss] Vhost: [2:1:3], Alias: default-host [JBoss] Vhost: [3:1:4], Alias: default-host [JBoss] Vhost: [3:1:5], Alias: localhost [JBoss] Vhost: [3:1:6], Alias: example.com [JBoss] Context: [2:1:1], Context: /, Status: ENABLED [JBoss] Context: [2:1:2], Context: /SessionTest, Status: ENABLED [JBoss] Context: [3:1:3], Context: /SessionTest, Status: ENABLED [JBoss] Context: [3:1:4], Context: /, Status: ENABLED [JBoss] [JBoss] at org.jboss.modcluster.mcmp.impl.DefaultMCMPResponseParser.parseInfoResponse(DefaultMCMPResponseParser.java:96) [JBoss] at org.jboss.modcluster.mcmp.impl.DefaultMCMPHandler.status(DefaultMCMPHandler.java:376) [JBoss] at org.jboss.modcluster.mcmp.impl.DefaultMCMPHandler.status(DefaultMCMPHandler.java:347) [JBoss] at org.jboss.modcluster.ModClusterService.status(ModClusterService.java:460) [JBoss] at org.jboss.modcluster.container.catalina.CatalinaEventHandlerAdapter.lifecycleEvent(CatalinaEventHandlerAdapter.java:239) [JBoss] at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:115) [jbossweb-7.0.10.Final-redhat-1.jar:] [JBoss] at org.apache.catalina.core.ContainerBase.backgroundProcess(ContainerBase.java:1337) [jbossweb-7.0.10.Final-redhat-1.jar:] [JBoss] at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1601) [jbossweb-7.0.10.Final-redhat-1.jar:] [JBoss] at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1590) [jbossweb-7.0.10.Final-redhat-1.jar:] [JBoss] at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_30] [JBoss]
2012/03/09 03:56:15:426 EST [DEBUG][Thread-13] HOST perf09.mw.lab.eng.bos.redhat.com:rootProcess:sf - JBossStartup, server started!
[JBoss] 03:56:19,725 ERROR [org.jboss.modcluster.mcmp.impl.DefaultMCMPHandler] (ContainerBackgroundProcessor[StandardEngine[jboss.web]])
{noformat}
while balancer keeps reporting:
{noformat}
[error] proxy: CLUSTER: (balancer://qacluster). All workers are in error state
{noformat}
and Mod_cluster manager web console shows:
{noformat}
Node REMOVED (http://perf03:8080):
Enable Contexts Disable Contexts
Balancer: qacluster,LBGroup: ,Flushpackets: Off,Flushwait: 10000,Ping: 10000000,Smax: 1,Ttl: 60000000,Status: NOTOK,Elected: 28883,Read: 464746,Transferred: 9063138,Connected: 0,Load: 1 
{noformat} al the time.

Any ideas?

Comment 1 Michal Karm Babacek 2012-03-09 09:23:58 UTC
Logs for EAP and balancer.

Comment 2 Michal Karm Babacek 2012-03-09 09:23:58 UTC
Attachment: Added: httpd-logs.zip
Attachment: Added: perf01-logs-and-config.zip


Comment 3 Michal Karm Babacek 2012-03-13 21:50:33 UTC
The cause of this error was:
 * [JBPAPP-8451] mod_cluster does not generate UUID automatically


Comment 4 Anne-Louise Tangring 2012-11-05 13:47:37 UTC
Docs QE Status: Removed: NEW