Description of problem: On volumes made up of bricks on 16 distinct hosts, starting rebalanace on 3 volumes simultaneously fails on 2 out 3 of the volumes. Version-Release number of selected component (if applicable): rhsc-cb17 How reproducible: every time Steps to Reproduce: 1. create 3 volumes which has bricks on 16 distinct hosts 2. ctrl click to select 3 hosts in the main volume tab 3. right click on on of the selected hosts and choose rebalance from the context menu Actual results: 'could not start Gluster volume x rebalance' event reported for 2 of the volumes rhsc-log-collector logs: http://rhsqe-repo.lab.eng.blr.redhat.com/dustin/sosreport-LogCollector-20140217141607.tar.xz Expected results: rebalance starts on all 3 volumes Additional info:
From vdsm logs, there's an exception on vol_three GlusterVolumeRebalanceStartFailedException: <unprintable GlusterVolumeRebalanceStartFailedException object> on vol_dis GlusterVolumeRebalanceStartFailedException: Volume rebalance start failed error: Another transaction could be in progress. Please try again after sometime. return code: 61 I'm not sure which prior operation on volume has obtained lock - which causes this. Will need help from gluster team to analyse.
If all 3 volumes being started span the same set of hosts, simultaneous start fails as the gluster CLI obtains a lock on the host for the start rebalance command.
Edited the doc text as discussed.
Thank you for submitting this issue for consideration in Red Hat Gluster Storage. The release for which you requested us to review, is now End of Life. Please See https://access.redhat.com/support/policy/updates/rhs/ If you can reproduce this bug against a currently maintained version of Red Hat Gluster Storage, please feel free to file a new report against the current release.