Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 902165 Details for
Bug 1104647
IllegalStateException: previousClusterSize[5] and newClusterSize[4] is not supported when undeploying storage node
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
server log
server.log (text/x-log), 153.01 KB, created by
Filip Brychta
on 2014-06-04 12:30:31 UTC
(
hide
)
Description:
server log
Filename:
MIME Type:
Creator:
Filip Brychta
Created:
2014-06-04 12:30:31 UTC
Size:
153.01 KB
patch
obsolete
>06:48:51,803 INFO [org.rhq.enterprise.server.core.StartupBean] (pool-7-thread-1) Creating timer to begin scanning for plugins... >06:48:51,814 INFO [org.rhq.enterprise.server.core.StartupBean] (pool-7-thread-1) -------------------------------------------------- >06:48:51,814 INFO [org.rhq.enterprise.server.core.StartupBean] (pool-7-thread-1) JBoss Operations Network 3.2.0.GA (build 055b880:0620403) Server started. >06:48:51,814 INFO [org.rhq.enterprise.server.core.StartupBean] (pool-7-thread-1) -------------------------------------------------- >06:49:06,336 INFO [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/jboss-remoting-servlet-invoker]] (http-/0.0.0.0:7080-1) ServerInvokerServlet: invokerObjectNameQuery=jboss.remoting:service=invoker,rhq.communications.connector.rhqtype=server,* >06:49:06,338 INFO [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/jboss-remoting-servlet-invoker]] (http-/0.0.0.0:7080-1) ServerInvokerServlet: Found RHQ remoting servlet: jboss.remoting:service=invoker,transport=servlet,host=10.16.23.118,port=7080,rhq.communications.connector.rhqtype=server >06:49:06,420 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Agent [fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >06:49:06,651 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Agent [fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 06:49:06 EDT 2014 >06:49:07,854 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Got agent registration request for existing agent: fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.118:16163][4.9.0.JON320GA(0620403)] - Will not regenerate a new token >06:49:21,213 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [47]ms to reload global cache >06:49:21,313 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [72]ms to reload cache for 1 agents >06:58:55,765 WARN [org.rhq.enterprise.communications.command.server.CommandProcessor] (http-/0.0.0.0:7080-1) {CommandProcessor.failed-authentication}Command failed to be authenticated! This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, rhq.security-token=O98yhWPusqN5LSzrwXxjvvDaWrO6p+Om8jsjjAiLMPE4hH+qA+Gzou1gu11lAJ8NPno=, rhq.externalizable-strategy=AGENT}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[connectAgent]}] >06:58:56,923 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Got agent registration request for new agent: fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.156:16163][4.9.0.JON320GA(0620403)] >06:58:57,073 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Agent [fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >06:58:57,206 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-1) Agent [fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 06:58:57 EDT 2014 >07:00:00,052 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Data Purge Job STARTING >07:00:00,069 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Measurement data compression starting at Wed Jun 04 07:00:00 EDT 2014 >07:00:03,776 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-3) Finished computing aggregates for table [raw_metrics]3702 ms >07:00:04,520 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-3) Finished computing aggregates for table [one_hour_metrics] 0 ms >07:00:04,521 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-3) Finished computing aggregates for table [six_hour_metrics] 0 ms >07:00:04,521 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Measurement data compression completed in [4452]ms >07:00:04,522 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Measurement calltime data purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,523 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging calltime data that is older than Sun May 04 07:00:04 EDT 2014 >07:00:04,541 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Calltime purged [0] - completed in [19]ms >07:00:04,542 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Event data purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,542 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging event data older than Wed May 21 07:00:04 EDT 2014 >07:00:04,564 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Event data purged [0] - completed in [23]ms >07:00:04,565 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert data purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,565 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging alert data older than Sun May 04 07:00:04 EDT 2014 >07:00:04,658 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert data purged [0] - completed in [93]ms >07:00:04,659 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert definition unused purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,722 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert definitions purged [0] - completed in [63]ms >07:00:04,723 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert condition orphan purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,736 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purged [0] orphan alert conditions - completed in [13]ms >07:00:04,737 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Alert notification orphan purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,746 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purged [0] orphan alert notifications - completed in [10]ms >07:00:04,747 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Trait data purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,747 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging traits that are older than Tue Jun 04 07:00:04 EDT 2013 >07:00:04,837 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Traits data purged [0] - completed in [91]ms >07:00:04,839 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Availability data purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,839 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging availablities that are older than Tue Jun 04 07:00:04 EDT 2013 >07:00:04,879 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Availability data purged [0] - completed in [41]ms >07:00:04,880 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Drift file orphan purge starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,880 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purging orphaned drift files older than Sun May 04 07:00:04 EDT 2014 >07:00:04,962 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Purged [0] orphaned drift files - completed in [82]ms >07:00:04,963 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Database maintenance starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,965 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Performing hourly database maintenance >07:00:04,975 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Database maintenance completed in [12]ms >07:00:04,977 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Auto-calculation of baselines starting at Wed Jun 04 07:00:04 EDT 2014 >07:00:04,991 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-3) Calculating auto baselines >07:00:04,991 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-3) Deleting baselines computations older than Sun Jun 01 07:00:04 EDT 2014 >07:00:04,992 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-3) Inserting new baselines using last 7 days of 1H data >07:00:05,000 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-3) Removed [0] old baselines - they will now be recalculated (8)ms >07:00:13,284 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-3) Calculated and inserted [889] new baselines. (8284)ms >07:00:13,338 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Auto-calculation of baselines completed in [8361]ms >07:00:13,338 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Auto-calculation of OOBs starting >07:00:13,353 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-3) Removed [0] outdated OOBs >07:00:13,366 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-3) Computing OOBs >07:00:16,004 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-3) Finished calculating 4 OOBs in 2638 ms >07:00:16,005 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Auto-calculation of OOBs completed in [2667]ms >07:00:16,005 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-3) Data Purge Job FINISHED [15953]ms >07:00:21,280 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 1) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [126]ms to reload cache for 2 agents >07:00:44,617 INFO [org.rhq.helpers.rtfilter.filter.RtFilter] (http-/0.0.0.0:7080-5) -- Filter openFile: Writing response-time log for webapp with context root 'coregui' to '/home/hudson/jon-server-3.2.0.GA/logs/rt/coregui_rt.log' (hashCode=897223058)... >07:00:51,400 INFO [org.apache.struts.tiles.TilesRequestProcessor] (http-/0.0.0.0:7080-6) Tiles definition factory found for request processor ''. >07:00:51,500 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: BindDN >07:00:51,501 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: Filter >07:00:51,501 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: java.naming.factory.initial >07:00:51,502 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: LoginProperty >07:00:51,502 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: BaseDN >07:00:51,502 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: GroupFilter >07:00:51,502 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: java.naming.provider.url >07:00:51,503 WARN [org.jboss.security] (http-/0.0.0.0:7080-6) PBOX000234: Invalid or misspelled module option: BindPW >07:00:51,837 INFO [org.rhq.helpers.rtfilter.filter.RtFilter] (http-/0.0.0.0:7080-6) -- Filter openFile: Writing response-time log for webapp with context root 'portal' to '/home/hudson/jon-server-3.2.0.GA/logs/rt/portal_rt.log' (hashCode=1139132690)... >07:05:21,211 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 5) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [59]ms to reload cache for 1 agents >07:05:48,762 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-4) Linking Resource[id=10117, uuid=5ff0ad1c-b022-48bf-9ff3-1740ab18dbe2, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] to storage node at fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com >07:05:48,785 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-4) Did not find storage node with address [fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com] Searching by IP address [10.16.23.156] >07:05:48,808 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-4) Scheduling cluster maintenance to deploy StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401879948804] into the storage cluster... >07:05:48,809 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-4) Deploying StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401879948804] >07:05:48,833 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-4) Announcing StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401879948804] to storage node cluster. >07:05:48,842 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-4) Announcing StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401879948804] to cluster node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:05:51,205 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 9) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [53]ms to reload global cache >07:05:51,276 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 9) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [48]ms to reload cache for 1 agents >07:05:51,666 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Successfully announced new storage node to storage cluster >07:05:51,842 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Preparing to bootstrap StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401879948804] into cluster... >07:05:59,936 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) New Cassandra host /10.16.23.156 added >07:05:59,978 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.156 added >07:05:59,978 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) Storage cluster is up >07:05:59,979 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage cluster is up >07:05:59,979 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.156 is up >07:05:59,991 INFO [org.rhq.server.metrics.StorageSession] (Cassandra Java Driver worker-1) /10.16.23.156 is down >07:05:59,997 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Cassandra Java Driver worker-1) Storage node at 10.16.23.156 is down >07:06:21,223 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 10) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [43]ms to reload global cache >07:06:21,307 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 10) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [71]ms to reload cache for 1 agents >07:06:23,102 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) The prepare for bootstrap operation completed successfully for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401879948804] >07:06:26,377 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401879948804] >07:06:27,679 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Finished running add node maintenance for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401879948804] >07:06:27,685 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Running addNodeMaintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:06:46,370 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Finished running add node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:06:46,377 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Finished running add node maintenance on all cluster nodes >07:07:03,723 INFO [org.rhq.server.metrics.StorageSession] (Reconnection-0) /10.16.23.156 is up >07:07:03,723 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Reconnection-0) Storage node at 10.16.23.156 is up >07:10:46,623 WARN [org.rhq.enterprise.communications.command.server.CommandProcessor] (http-/0.0.0.0:7080-2) {CommandProcessor.failed-authentication}Command failed to be authenticated! This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, rhq.security-token=Ggoftbj1QDjP8PtIuTStordmOkjIgXqFKLMJVlc/E1qhHJNlG3ahl5c2bOI/0vLEw/A=, rhq.externalizable-strategy=AGENT}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[connectAgent]}] >07:10:47,759 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-2) Got agent registration request for new agent: fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.185:16163][4.9.0.JON320GA(0620403)] >07:10:47,895 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-2) Agent [fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >07:10:48,054 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-2) Agent [fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 07:10:48 EDT 2014 >07:21:51,289 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 1) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [135]ms to reload cache for 2 agents >07:21:55,069 INFO [org.rhq.enterprise.server.util.concurrent.InventoryReportSerializer] (http-/0.0.0.0:7080-7) tid=266; agent=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com: releasing write lock after being locked for millis=5060 >07:22:10,200 WARN [org.rhq.enterprise.communications.command.server.CommandProcessor] (http-/0.0.0.0:7080-7) {CommandProcessor.failed-authentication}Command failed to be authenticated! This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, rhq.security-token=3cpfXQQs71xab7iiwdGkcTDjF+Jr25Emjn73fpLMtJjK9CbexNNEJRvCUXpftN1tzp0=, rhq.externalizable-strategy=AGENT}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[connectAgent]}] >07:22:11,337 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-7) Got agent registration request for new agent: fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.63:16163][4.9.0.JON320GA(0620403)] >07:22:11,496 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-7) Agent [fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >07:22:11,602 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-7) Agent [fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 07:22:11 EDT 2014 >07:22:19,146 INFO [org.rhq.enterprise.server.util.concurrent.InventoryReportSerializer] (http-/0.0.0.0:7080-5) tid=254; agent=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com: releasing write lock after being locked for millis=7659 >07:22:21,348 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [153]ms to reload cache for 2 agents >07:22:45,249 INFO [org.rhq.enterprise.server.util.concurrent.InventoryReportSerializer] (http-/0.0.0.0:7080-5) tid=254; agent=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com: releasing write lock after being locked for millis=10513 >07:22:51,256 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 1) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [113]ms to reload cache for 1 agents >07:23:36,154 WARN [org.rhq.enterprise.server.discovery.DiscoveryServerServiceImpl] (http-/0.0.0.0:7080-5) Performance: inventory merge (34752)ms >07:23:36,155 INFO [org.rhq.enterprise.server.util.concurrent.InventoryReportSerializer] (http-/0.0.0.0:7080-5) tid=254; agent=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com: releasing write lock after being locked for millis=34753 >07:23:51,385 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 10) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [185]ms to reload cache for 1 agents >07:25:44,187 WARN [org.rhq.enterprise.communications.command.server.CommandProcessor] (http-/0.0.0.0:7080-6) {CommandProcessor.failed-authentication}Command failed to be authenticated! This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, rhq.security-token=EhT+jjs7CaFNorFTCAfVaf/deo7XHnmVKDd6mz2tUub696pIAH/yrUAtBytHmDSVR2o=, rhq.externalizable-strategy=AGENT}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[connectAgent]}] >07:25:45,319 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-6) Got agent registration request for new agent: fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.104:16163][4.9.0.JON320GA(0620403)] >07:25:45,508 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-6) Agent [fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >07:25:45,615 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-6) Agent [fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 07:25:45 EDT 2014 >07:26:07,721 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-2) Linking Resource[id=10835, uuid=5c4f6b15-e1f2-4119-bf69-ba65db17f230, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] to storage node at fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com >07:26:07,734 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-2) Did not find storage node with address [fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com] Searching by IP address [10.16.23.185] >07:26:07,746 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-2) Scheduling cluster maintenance to deploy StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401881167744] into the storage cluster... >07:26:07,746 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-2) Deploying StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401881167744] >07:26:07,757 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-2) Announcing StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881167744] to storage node cluster. >07:26:07,760 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-2) Announcing StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881167744] to cluster node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:26:10,305 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 1) Announcing StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881167744] to cluster node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:26:12,745 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Successfully announced new storage node to storage cluster >07:26:12,853 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Preparing to bootstrap StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401881167744] into cluster... >07:26:20,149 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) New Cassandra host /10.16.23.185 added >07:26:20,177 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.185 added >07:26:20,177 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.185 is up >07:26:20,179 INFO [org.rhq.server.metrics.StorageSession] (Cassandra Java Driver worker-3) /10.16.23.185 is down >07:26:20,179 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Cassandra Java Driver worker-3) Storage node at 10.16.23.185 is down >07:26:21,193 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 9) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [51]ms to reload global cache >07:26:21,311 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 9) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [53]ms to reload cache for 1 agents >07:26:43,948 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 1) The prepare for bootstrap operation completed successfully for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401881167744] >07:26:44,143 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 1) Running addNodeMaintenance for storage node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401881167744] >07:26:45,657 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished running add node maintenance for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401881167744] >07:26:45,663 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:26:49,830 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 3) Finished running add node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:26:49,836 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 3) Running addNodeMaintenance for storage node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:26:55,023 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:26:55,028 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance on all cluster nodes >07:27:23,751 INFO [org.rhq.server.metrics.StorageSession] (Reconnection-1) /10.16.23.185 is up >07:27:23,752 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Reconnection-1) Storage node at 10.16.23.185 is up >07:28:18,233 WARN [org.rhq.enterprise.communications.command.server.CommandProcessor] (http-/0.0.0.0:7080-3) {CommandProcessor.failed-authentication}Command failed to be authenticated! This command will be ignored and not processed: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, rhq.security-token=8Ek1kuztA2dHQMO+CBU+/KIEe/uOQIdV/lFPQp14PDTpr5k0ADcLJ+hiW1O7nhrJ5BE=, rhq.externalizable-strategy=AGENT}]; params=[{targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService, invocation=NameBasedInvocation[connectAgent]}] >07:28:19,378 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-3) Got agent registration request for new agent: fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com[10.16.23.114:16163][4.9.0.JON320GA(0620403)] >07:28:19,558 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-3) Agent [fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com][4.9.0.JON320GA(0620403)] would like to connect to this server >07:28:19,675 INFO [org.rhq.enterprise.server.core.CoreServerServiceImpl] (http-/0.0.0.0:7080-3) Agent [fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com] has connected to this server at Wed Jun 04 07:28:19 EDT 2014 >07:29:21,330 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 9) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [162]ms to reload cache for 3 agents >07:29:51,223 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [49]ms to reload cache for 1 agents >07:29:53,662 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-5) Linking Resource[id=10960, uuid=9b8200d9-f122-4be3-9ace-53d6eb731391, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] to storage node at fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com >07:29:53,674 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-5) Did not find storage node with address [fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com] Searching by IP address [10.16.23.63] >07:29:53,688 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-5) Scheduling cluster maintenance to deploy StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401881393686] into the storage cluster... >07:29:53,688 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-5) Deploying StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401881393686] >07:29:53,700 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-5) Announcing StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881393686] to storage node cluster. >07:29:53,703 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-5) Announcing StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881393686] to cluster node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:29:55,332 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Announcing StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881393686] to cluster node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:29:57,172 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Announcing StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401881393686] to cluster node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:29:58,919 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Successfully announced new storage node to storage cluster >07:29:59,017 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Preparing to bootstrap StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401881393686] into cluster... >07:30:05,872 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) New Cassandra host /10.16.23.63 added >07:30:05,908 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.63 added >07:30:05,908 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.63 is up >07:30:05,910 INFO [org.rhq.server.metrics.StorageSession] (Cassandra Java Driver worker-5) /10.16.23.63 is down >07:30:05,910 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Cassandra Java Driver worker-5) Storage node at 10.16.23.63 is down >07:30:21,214 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [46]ms to reload global cache >07:30:21,294 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [60]ms to reload cache for 1 agents >07:30:30,053 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 1) The prepare for bootstrap operation completed successfully for StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401881393686] >07:30:32,416 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 1) Running addNodeMaintenance for storage node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401881393686] >07:30:34,581 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Finished running add node maintenance for StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401881393686] >07:30:34,586 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Running addNodeMaintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:31:09,827 INFO [org.rhq.server.metrics.StorageSession] (Reconnection-1) /10.16.23.63 is up >07:31:09,827 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Reconnection-1) Storage node at 10.16.23.63 is up >07:33:59,430 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Finished running add node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:33:59,442 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Running addNodeMaintenance for storage node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:38:22,219 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished running add node maintenance for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:38:22,226 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:42:47,521 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:42:47,526 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance on all cluster nodes >07:44:39,870 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-7) Linking Resource[id=10992, uuid=ddfb43a0-3c98-4064-9ab1-d9579448a53e, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] to storage node at fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com >07:44:39,884 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-7) Did not find storage node with address [fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com] Searching by IP address [10.16.23.104] >07:44:39,899 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-7) Scheduling cluster maintenance to deploy StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401882279896] into the storage cluster... >07:44:39,899 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-7) Deploying StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401882279896] >07:44:39,912 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-7) Announcing StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882279896] to storage node cluster. >07:44:39,916 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-7) Announcing StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882279896] to cluster node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:44:41,661 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Announcing StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882279896] to cluster node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:44:43,428 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Announcing StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882279896] to cluster node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:44:45,028 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Announcing StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882279896] to cluster node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:44:47,029 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Successfully announced new storage node to storage cluster >07:44:47,210 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Preparing to bootstrap StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401882279896] into cluster... >07:44:51,171 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [42]ms to reload global cache >07:44:51,279 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 2) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [92]ms to reload cache for 1 agents >07:44:57,949 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) New Cassandra host /10.16.23.104 added >07:44:57,994 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.104 added >07:44:57,994 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.104 is up >07:44:57,996 INFO [org.rhq.server.metrics.StorageSession] (Cassandra Java Driver worker-6) /10.16.23.104 is down >07:44:57,996 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Cassandra Java Driver worker-6) Storage node at 10.16.23.104 is down >07:45:20,225 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) The prepare for bootstrap operation completed successfully for StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401882279896] >07:45:20,322 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Running addNodeMaintenance for storage node StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401882279896] >07:45:21,573 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished running add node maintenance for StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401882279896] >07:45:21,580 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:45:24,029 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Finished running add node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:45:24,035 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Running addNodeMaintenance for storage node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:45:26,912 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Finished running add node maintenance for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:45:26,917 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Running addNodeMaintenance for storage node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:45:30,488 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished running add node maintenance for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:45:30,495 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:45:34,019 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance for StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:45:34,027 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Finished running add node maintenance on all cluster nodes >07:46:01,753 INFO [org.rhq.server.metrics.StorageSession] (Reconnection-0) /10.16.23.104 is up >07:46:01,754 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Reconnection-0) Storage node at 10.16.23.104 is up >07:47:26,784 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-8) Linking Resource[id=11055, uuid=9fdecabc-d657-4ccb-a301-5c716f8ebdd3, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] to storage node at fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com >07:47:26,800 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-8) Did not find storage node with address [fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com] Searching by IP address [10.16.23.114] >07:47:26,813 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-8) Scheduling cluster maintenance to deploy StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401882446812] into the storage cluster... >07:47:26,814 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-8) Deploying StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=INSTALLED, mtime=1401882446812] >07:47:26,827 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-8) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to storage node cluster. >07:47:26,831 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-8) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to cluster node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:47:28,604 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to cluster node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:47:30,152 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to cluster node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:47:31,499 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 7) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to cluster node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:47:33,056 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Announcing StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ANNOUNCE, mtime=1401882446812] to cluster node StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:47:34,588 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Successfully announced new storage node to storage cluster >07:47:34,701 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Preparing to bootstrap StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401882446812] into cluster... >07:47:42,616 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) New Cassandra host /10.16.23.114 added >07:47:42,658 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.114 added >07:47:42,658 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.114 is up >07:47:42,660 INFO [org.rhq.server.metrics.StorageSession] (Cassandra Java Driver worker-8) /10.16.23.114 is down >07:47:42,661 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Cassandra Java Driver worker-8) Storage node at 10.16.23.114 is down >07:47:51,190 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 8) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [61]ms to reload global cache >07:47:51,316 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 8) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [96]ms to reload cache for 1 agents >07:48:05,774 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) The prepare for bootstrap operation completed successfully for StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=BOOTSTRAP, mtime=1401882446812] >07:48:05,919 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401882446812] >07:48:07,387 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Finished running add node maintenance for StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=ADD_MAINTENANCE, mtime=1401882446812] >07:48:07,392 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Running addNodeMaintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:48:11,381 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Finished running add node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:48:11,391 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Running addNodeMaintenance for storage node StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:48:13,855 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished running add node maintenance for StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:48:13,861 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running addNodeMaintenance for storage node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:48:17,979 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Finished running add node maintenance for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:48:17,984 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 10) Running addNodeMaintenance for storage node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:48:21,505 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Finished running add node maintenance for StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:48:21,510 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Running addNodeMaintenance for storage node StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:48:25,301 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Finished running add node maintenance for StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:48:25,308 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Finished running add node maintenance on all cluster nodes >07:48:46,280 INFO [org.rhq.server.metrics.StorageSession] (Reconnection-1) /10.16.23.114 is up >07:48:46,280 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Reconnection-1) Storage node at 10.16.23.114 is up >07:50:43,282 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-6) Preparing to decommission StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401879948804] >07:51:23,683 INFO [com.datastax.driver.core.Cluster] (Scheduled Tasks-0) Cassandra host /10.16.23.156 removed >07:51:23,784 INFO [org.rhq.server.metrics.StorageSession] (Scheduled Tasks-0) /10.16.23.156 has been removed >07:51:23,785 INFO [org.rhq.enterprise.server.storage.StorageClusterMonitor] (Scheduled Tasks-0) Storage node at 10.16.23.156 has been removed from the cluster >07:51:53,931 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Successfully decommissioned StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=DECOMMISSION, mtime=1401879948804] >07:51:54,032 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 4) Running remove node maintenance for storage node StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:51:56,612 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Finished remove node maintenance for StorageNode[id=1001, address=fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401878035973] >07:51:56,630 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 2) Running remove node maintenance for storage node StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:51:59,648 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Finished remove node maintenance for StorageNode[id=10002, address=fbr-jon32-dr1-2.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881167744] >07:51:59,676 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Running remove node maintenance for storage node StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:52:03,724 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Finished remove node maintenance for StorageNode[id=10003, address=fbr-jon32-dr1-3.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401881393686] >07:52:03,739 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 6) Running remove node maintenance for storage node StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:52:06,701 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Finished remove node maintenance for StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:52:06,715 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Running remove node maintenance for storage node StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882446812] >07:52:10,926 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Finished remove node maintenance for StorageNode[id=10005, address=fbr-jon32-dr1-5.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882446812] >07:52:10,932 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Finished running remove node maintenance on all cluster nodes >07:52:11,026 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Unannouncing StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNANNOUNCE, mtime=1401879948804] >07:52:18,075 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Successfully unannounced StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNANNOUNCE, mtime=1401879948804] to storage cluster >07:52:18,165 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 9) Uninstalling StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNINSTALL, mtime=1401879948804] >07:52:18,914 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Successfully uninstalled StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNINSTALL, mtime=1401879948804] from disk >07:52:18,945 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Removing storage node resource Resource[id=10117, uuid=5ff0ad1c-b022-48bf-9ff3-1740ab18dbe2, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA] from inventory >07:52:19,247 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) Removing storage node entity StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNINSTALL, mtime=1401879948804] from database >07:52:19,247 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (EJB default - 8) StorageNode[id=10001, address=fbr-jon32-dr1.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=UNINSTALL, mtime=1401879948804] has been undeployed >07:52:22,974 ERROR [org.rhq.enterprise.server.alert.engine.internal.AlertConditionCacheCoordinator] (EJB default - 6) Could not find agent for scheduleId = 11877 >07:53:22,293 INFO [org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean] (http-/0.0.0.0:7080-6) Preparing to decommission StorageNode[id=10004, address=fbr-jon32-dr1-4.bc.jonqe.lab.eng.bos.redhat.com, cqlPort=9142, operationMode=NORMAL, mtime=1401882279896] >07:53:22,416 ERROR [org.jboss.as.ejb3] (http-/0.0.0.0:7080-6) javax.ejb.EJBTransactionRolledbackException: previousClusterSize[5] and newClusterSize[4] is not supported >07:53:22,417 ERROR [org.jboss.as.ejb3.invocation] (http-/0.0.0.0:7080-6) JBAS014134: EJB Invocation failed on component StorageNodeOperationsHandlerBean for method public abstract void org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerLocal.decommissionStorageNode(org.rhq.core.domain.auth.Subject,org.rhq.core.domain.cloud.StorageNode): javax.ejb.EJBTransactionRolledbackException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:138) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:228) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:317) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerLocal$$$view137.decommissionStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.cloud.StorageNodeManagerBean.undeployStorageNode(StorageNodeManagerBean.java:303) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:248) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:315) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.cloud.StorageNodeManagerLocal$$$view67.undeployStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.coregui.server.gwt.StorageGWTServiceImpl.undeployStorageNode(StorageGWTServiceImpl.java:219) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:561) > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:208) > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:248) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at org.rhq.coregui.server.gwt.AbstractGWTServiceImpl.service(AbstractGWTServiceImpl.java:88) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at sun.reflect.GeneratedMethodAccessor116.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:155) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:288) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.rhq.helpers.rtfilter.filter.RtFilter.doFilter(RtFilter.java:125) [rhq-rtfilter-4.9.0.JON320GA.jar:4.9.0.JON320GA] > at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.rhq.coregui.server.filter.CacheControlFilter.doFilter(CacheControlFilter.java:70) > at sun.reflect.GeneratedMethodAccessor166.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.lang.IllegalStateException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.updateSchemaIfNecessary(StorageNodeOperationsHandlerBean.java:833) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.decommissionStorageNode(StorageNodeOperationsHandlerBean.java:186) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:226) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > ... 159 more > >07:53:22,571 ERROR [org.jboss.as.ejb3.invocation] (http-/0.0.0.0:7080-6) JBAS014134: EJB Invocation failed on component StorageNodeManagerBean for method public abstract void org.rhq.enterprise.server.cloud.StorageNodeManagerLocal.undeployStorageNode(org.rhq.core.domain.auth.Subject,org.rhq.core.domain.cloud.StorageNode): javax.ejb.EJBTransactionRolledbackException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:138) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:228) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:317) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerLocal$$$view137.decommissionStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.cloud.StorageNodeManagerBean.undeployStorageNode(StorageNodeManagerBean.java:303) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:248) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:315) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.cloud.StorageNodeManagerLocal$$$view67.undeployStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.coregui.server.gwt.StorageGWTServiceImpl.undeployStorageNode(StorageGWTServiceImpl.java:219) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:561) > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:208) > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:248) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at org.rhq.coregui.server.gwt.AbstractGWTServiceImpl.service(AbstractGWTServiceImpl.java:88) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at sun.reflect.GeneratedMethodAccessor116.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:155) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:288) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.rhq.helpers.rtfilter.filter.RtFilter.doFilter(RtFilter.java:125) [rhq-rtfilter-4.9.0.JON320GA.jar:4.9.0.JON320GA] > at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.rhq.coregui.server.filter.CacheControlFilter.doFilter(CacheControlFilter.java:70) > at sun.reflect.GeneratedMethodAccessor166.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.lang.IllegalStateException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.updateSchemaIfNecessary(StorageNodeOperationsHandlerBean.java:833) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.decommissionStorageNode(StorageNodeOperationsHandlerBean.java:186) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:226) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > ... 159 more > >07:53:22,591 WARN [org.rhq.coregui.server.gwt.StorageGWTServiceImpl] (http-/0.0.0.0:7080-6) Sending exception to client: [1401882802591] : javax.ejb.EJBTransactionRolledbackException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:138) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:228) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:317) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerLocal$$$view137.decommissionStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.cloud.StorageNodeManagerBean.undeployStorageNode(StorageNodeManagerBean.java:303) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:248) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:315) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:214) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.rhq.enterprise.server.cloud.StorageNodeManagerLocal$$$view67.undeployStorageNode(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.coregui.server.gwt.StorageGWTServiceImpl.undeployStorageNode(StorageGWTServiceImpl.java:219) [classes:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:561) [gwt-servlet-2.5.0.jar:] > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:208) [gwt-servlet-2.5.0.jar:] > at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:248) [gwt-servlet-2.5.0.jar:] > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) [gwt-servlet-2.5.0.jar:] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at org.rhq.coregui.server.gwt.AbstractGWTServiceImpl.service(AbstractGWTServiceImpl.java:88) [classes:] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.2.Final-redhat-1.jar:1.0.2.Final-redhat-1] > at sun.reflect.GeneratedMethodAccessor116.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:155) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:288) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.rhq.helpers.rtfilter.filter.RtFilter.doFilter(RtFilter.java:125) [rhq-rtfilter-4.9.0.JON320GA.jar:4.9.0.JON320GA] > at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.rhq.coregui.server.filter.CacheControlFilter.doFilter(CacheControlFilter.java:70) [classes:] > at sun.reflect.GeneratedMethodAccessor166.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:263) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:261) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at javax.security.auth.Subject.doAsPrivileged(Subject.java:536) [rt.jar:1.7.0_45] > at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:295) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:236) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:59) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:197) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_45] > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(WebNonTxEmCloserValve.java:50) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) [jboss-as-web-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:653) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) [jbossweb-7.2.2.Final-redhat-4.jar:7.2.2.Final-redhat-4] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.lang.IllegalStateException: previousClusterSize[5] and newClusterSize[4] is not supported > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.updateSchemaIfNecessary(StorageNodeOperationsHandlerBean.java:833) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at org.rhq.enterprise.server.storage.StorageNodeOperationsHandlerBean.decommissionStorageNode(StorageNodeOperationsHandlerBean.java:186) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.PerformanceMonitorInterceptor.monitorHibernatePerformance(PerformanceMonitorInterceptor.java:32) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.common.TransactionInterruptInterceptor.addCheckedActionToTransactionManager(TransactionInterruptInterceptor.java:78) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.rhq.enterprise.server.authz.RequiredPermissionsInterceptor.checkRequiredPermissions(RequiredPermissionsInterceptor.java:156) [rhq-server.jar:4.9.0.JON320GA-redhat-2] > at sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) [jboss-as-jpa-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.2.Final-redhat-1.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:226) [jboss-as-ejb3-7.2.1.Final-redhat-10.jar:7.2.1.Final-redhat-10] > ... 159 more > >07:55:10,027 INFO [org.rhq.enterprise.server.scheduler.jobs.AsyncResourceDeleteJob] (RHQScheduler_Worker-3) Async resource deletion - 78 successful, 0 failed, took [18586] ms >08:00:00,032 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Data Purge Job STARTING >08:00:00,048 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Measurement data compression starting at Wed Jun 04 08:00:00 EDT 2014 >08:00:34,884 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-5) Finished computing aggregates for table [raw_metrics]34834 ms >08:00:40,557 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-5) Finished computing aggregates for table [one_hour_metrics] 0 ms >08:00:40,557 INFO [org.rhq.server.metrics.MetricsServer] (RHQScheduler_Worker-5) Finished computing aggregates for table [six_hour_metrics] 0 ms >08:00:40,557 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Measurement data compression completed in [40510]ms >08:00:40,559 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Measurement calltime data purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,559 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging calltime data that is older than Sun May 04 08:00:40 EDT 2014 >08:00:40,564 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Calltime purged [0] - completed in [5]ms >08:00:40,565 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Event data purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,566 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging event data older than Wed May 21 08:00:40 EDT 2014 >08:00:40,569 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Event data purged [0] - completed in [4]ms >08:00:40,570 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert data purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,570 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging alert data older than Sun May 04 08:00:40 EDT 2014 >08:00:40,575 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert data purged [0] - completed in [6]ms >08:00:40,576 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert definition unused purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,581 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert definitions purged [0] - completed in [5]ms >08:00:40,581 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert condition orphan purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,585 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purged [0] orphan alert conditions - completed in [4]ms >08:00:40,586 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Alert notification orphan purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,590 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purged [0] orphan alert notifications - completed in [4]ms >08:00:40,590 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Trait data purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,590 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging traits that are older than Tue Jun 04 08:00:40 EDT 2013 >08:00:40,594 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Traits data purged [0] - completed in [4]ms >08:00:40,594 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Availability data purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,595 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging availablities that are older than Tue Jun 04 08:00:40 EDT 2013 >08:00:40,599 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Availability data purged [0] - completed in [5]ms >08:00:40,599 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Drift file orphan purge starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,599 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purging orphaned drift files older than Sun May 04 08:00:40 EDT 2014 >08:00:40,616 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Purged [0] orphaned drift files - completed in [17]ms >08:00:40,617 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Database maintenance starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,617 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Performing hourly database maintenance >08:00:40,624 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Database maintenance completed in [7]ms >08:00:40,625 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Auto-calculation of baselines starting at Wed Jun 04 08:00:40 EDT 2014 >08:00:40,633 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-5) Calculating auto baselines >08:00:40,633 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-5) Deleting baselines computations older than Sun Jun 01 08:00:40 EDT 2014 >08:00:40,633 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-5) Inserting new baselines using last 7 days of 1H data >08:00:40,638 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-5) Removed [0] old baselines - they will now be recalculated (4)ms >08:01:28,111 INFO [org.rhq.enterprise.server.measurement.MeasurementBaselineManagerBean] (RHQScheduler_Worker-5) Calculated and inserted [5642] new baselines. (47473)ms >08:01:28,151 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Auto-calculation of baselines completed in [47526]ms >08:01:28,151 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Auto-calculation of OOBs starting >08:01:28,160 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-5) Removed [0] outdated OOBs >08:01:28,172 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-5) Computing OOBs >08:01:41,524 INFO [org.rhq.enterprise.server.measurement.MeasurementOOBManagerBean] (RHQScheduler_Worker-5) Finished calculating 81 OOBs in 13351 ms >08:01:41,525 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Auto-calculation of OOBs completed in [13374]ms >08:01:41,525 INFO [org.rhq.enterprise.server.scheduler.jobs.DataPurgeJob] (RHQScheduler_Worker-5) Data Purge Job FINISHED [101493]ms >08:01:51,824 INFO [org.rhq.enterprise.server.cloud.instance.CacheConsistencyManagerBean] (EJB default - 8) fbr-jon32-cp2-ora.bc.jonqe.lab.eng.bos.redhat.com took [594]ms to reload cache for 6 agents >08:19:34,180 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-56) Retrieved load metrics for StorageNode[id=10005, address=null, cqlPort=0, operationMode=null, mtime=0] in 339 ms >08:19:35,245 INFO [org.rhq.enterprise.server.cloud.StorageNodeManagerBean] (http-/0.0.0.0:7080-48) Retrieved unacked alerts for StorageNode[id=10005, address=null, cqlPort=0, operationMode=null, mtime=0] in 2327
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1104647
: 902165 |
902166