Description of problem:
On a three node cluster with brick-mux enabled, Power off one of the nodes in the cluster and perform any volume set operation on 5 volumes "performance.client-io-threads on". After setting the option power on the node.
After powering on bricks are offline on most of the volumes.
Version-Release number of selected component (if applicable):
Steps to Reproduce:
1. On a three cluster with brick mux enabled, create 25 volumes and start mount 5 volumes
2. Power off one node say N1 in the cluster
3. Set a volume option on 5 volumes.
4. Power on the node(N1) which is turned off
After powering on, the volume option is updated on the volumes on Node N1 and bricks are offline for most of the volumes on N1
After powering on, bricks should be online on N1 and the volume option should be updated for the volumes.