There is a bug in glusterd where a replace-brick operation returns 1 but updates the list of bricks on the glusterd side. This is what has happened here. I am not able to find the bugzilla entry. From the cmd_history.log cmd_history (1).log:34:[2018-05-25 11:10:17.850306] : volume replace-brick nb_glusterfs_mongodb-5_22a87523-5ffb-11e8-9dde-005056a5aac9 10.70.46.75:/var/lib/heketi/mounts/vg_4011ccd7b65237d7ebd2dbba56a8886b/brick_221779a6b7afce4311fba85b61443c07/brick 10.70.47.89:/var/lib/heketi/mounts/vg_7581c8554e4ea2c452eb90a2c3e01390/brick_ac3ed65c973eef921b00e5f71ab874e9/brick commit force : FAILED : Commit failed on dhcp46-175.lab.eng.blr.redhat.com. Please check log file for details. From gluster vol info Volume Name: nb_glusterfs_mongodb-5_22a87523-5ffb-11e8-9dde-005056a5aac9 Type: Replicate Volume ID: 5cad9830-3892-4859-9257-47b262b372cd Status: Started Snapshot Count: 0 Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: 10.70.46.1:/var/lib/heketi/mounts/vg_8f5c1d1963326127326f9b33a732691a/brick_a3dc1a0846779ac709a347a2428ba8d6/brick Brick2: 10.70.46.175:/var/lib/heketi/mounts/vg_e2dc26ec7ea1a6eca27eb7a719d5b92e/brick_03b3fdbe13bd1c43b4b85dc0f11fa2ab/brick Brick3: 10.70.47.89:/var/lib/heketi/mounts/vg_7581c8554e4ea2c452eb90a2c3e01390/brick_ac3ed65c973eef921b00e5f71ab874e9/brick Options Reconfigured: nfs.disable: on transport.address-family: inet cluster.brick-multiplex: on Putting Needinfo on Atin for the same. The fix for it has to come in glusterd and is an intensive change. I propose to move this out of CNS 3.10.
*** This bug has been marked as a duplicate of bug 1598340 ***