Attachment 1957424 Details for Bug 2176424 – host-14-sanlock.log

host-14-sanlock.log

host-14-sanlock.log (text/plain), 83.96 KB, created by shan.wu on 2023-04-14 02:19:56 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: shan.wu

Created: 2023-04-14 02:19:56 UTC

Size: 83.96 KB

patch

obsolete

>2023-03-27 21:12:18 1146524 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:12:18 1146524 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:12:18 1146524 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:12:18 1146524 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:18 1146524 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:12:19 1146524 [26765]: s2:r5 paxos_acquire leader 1918212 owner 55 1 1146585
>2023-03-27 21:12:19 1146524 [26765]: s2:r5 ballot 1918213 phase1 write mbal 140592393222058
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 phase1 read 1:140592393220002:0:0:0:0:1918213:0,8:140592393220009:0:0:0:0:1918213:0,54:140592393222055:140592393222055:61:1:1146655:1918213:0,56:140592393220057:0:0:0:0:1918213:0,
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 phase1 read 57:140592393222058:0:0:0:0:1918213:0,59:140592393220060:0:0:0:0:1918213:0,60:140592393220061:140592393220061:61:1:1146655:1918213:0,63:140592393220064:0:0:0:0:1918213:0,
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 mode[96] shared 1 gen 1
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 phase1 read 70:140592393220071:0:0:0:0:1918213:0,89:140592393220090:140592393220090:61:1:1146655:1918213:0,
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 choose bk_max[54] lver 1918213 mbal 140592393222055 bal 140592393222055 inp 61 1 1146655
>2023-03-27 21:12:19 1146525 [26765]: s2:r5 ballot 1918213 phase2 write bal 140592393222058 inp 61 1 1146655 q_max 54
>2023-03-27 21:12:19 1146525 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:12:19 1146525 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:20 1146525 [26765]: s2:r5 ballot 1918213 phase2 read 1:140592393220002:0:0:0:0:1918213:0,8:140592393220009:0:0:0:0:1918213:0,54:140592393222055:140592393222055:61:1:1146655:1918213:0,55:140592393220056:0:0:0:0:1918213:0,
>2023-03-27 21:12:20 1146525 [26765]: s2:r5 ballot 1918213 abort2 larger mbal in bk[59] 140592393222060:0:0:0:0:1918213 our dblock 140592393222058:140592393222058:61:1:1146655:1918213
>2023-03-27 21:12:20 1146525 [26765]: s2:r5 ballot 1918213 phase2 read 56:140592393220057:0:0:0:0:1918213:0,57:140592393222058:140592393222058:61:1:1146655:1918213:0,59:140592393222060:0:0:0:0:1918213:0,
>2023-03-27 21:12:20 1146525 [26765]: s2:r5 paxos_acquire 1918213 retry delay 4720 us
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 paxos_acquire leader 1918212 owner 55 1 1146585
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 phase1 write mbal 140592393224058
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 phase1 read 1:140592393222002:0:0:0:0:1918213:0,8:140592393222009:0:0:0:0:1918213:0,54:140592393222055:140592393222055:61:1:1146655:1918213:0,55:140592393220056:0:0:0:0:1918213:0,
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 phase1 read 56:140592393222057:0:0:0:0:1918213:0,57:140592393224058:0:0:0:0:1918213:0,59:140592393222060:0:0:0:0:1918213:0,60:140592393222061:0:0:0:0:1918213:0,
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 mode[96] shared 2 gen 1
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 phase1 read 63:140592393222064:0:0:0:0:1918213:0,70:140592393222071:0:0:0:0:1918213:0,89:140592393222090:0:0:0:0:1918213:0,
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 choose bk_max[54] lver 1918213 mbal 140592393222055 bal 140592393222055 inp 61 1 1146655
>2023-03-27 21:12:20 1146526 [26765]: s2:r5 ballot 1918213 phase2 write bal 140592393224058 inp 61 1 1146655 q_max 54
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0,
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,44:4379894045:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 leader 1886509 dblocks 50:4379894051:4379894051:92:1:1146639:1886509:0,58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 leader 1886509 dblocks 80:4379892081:4379892081:92:1:1146639:1886509:0,82:4379892083:0:0:0:0:1886509:0,90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0,
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 100:4379892101:0:0:0:0:1886509:0,
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 4379892066 0 0 0 0 1886509
>2023-03-27 21:12:21 1146526 [31507]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146596 wait_start 1146495
>2023-03-27 21:12:21 1146527 [26765]: s2:r5 ballot 1918213 phase2 read 1:140592393222002:0:0:0:0:1918213:0,8:140592393222009:0:0:0:0:1918213:0,54:140592393224055:0:0:0:0:1918213:0,55:140592393220056:0:0:0:0:1918213:0,
>2023-03-27 21:12:21 1146527 [26765]: s2:r5 ballot 1918213 abort2 larger mbal in bk[59] 140592393224060:0:0:0:0:1918213 our dblock 140592393224058:140592393224058:61:1:1146655:1918213
>2023-03-27 21:12:21 1146527 [26765]: s2:r5 ballot 1918213 phase2 read 56:140592393222057:0:0:0:0:1918213:0,57:140592393224058:140592393224058:61:1:1146655:1918213:0,59:140592393224060:0:0:0:0:1918213:0,
>2023-03-27 21:12:21 1146527 [26765]: s2:r5 paxos_acquire 1918213 retry delay 618545 us
>2023-03-27 21:12:22 1146527 [26765]: s2:r5 paxos_acquire leader 1918212 owner 55 1 1146585
>2023-03-27 21:12:22 1146527 [26765]: s2:r5 ballot 1918213 phase1 write mbal 140592393226058
>2023-03-27 21:12:22 1146528 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 ballot 1918213 phase1 read 1:140592393224002:0:0:0:0:1918213:0,8:140592393224009:0:0:0:0:1918213:0,54:140592393224055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0,
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 ballot 1918213 abort1 larger mbal in bk[59] 140592393226060:0:0:0:0:1918213 our dblock 140592393226058:0:0:0:0:1918213
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 ballot 1918213 phase1 read 56:140592393224057:0:0:0:0:1918213:0,57:140592393226058:0:0:0:0:1918213:0,59:140592393226060:0:0:0:0:1918213:0,
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 paxos_acquire 1918213 retry delay 21415 us
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 paxos_acquire leader 1918212 owner 55 1 1146585
>2023-03-27 21:12:22 1146528 [26765]: s2:r5 ballot 1918213 phase1 write mbal 140592393228058
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 phase1 read 1:140592393226002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0,
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 phase1 read 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:0:0:0:0:1918213:0,59:140592393226060:140592393226060:61:1:1146655:1918213:0,60:140592393226061:0:0:0:0:1918213:0,
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 mode[96] shared 3 gen 1
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 phase1 read 63:140592393226064:0:0:0:0:1918213:0,70:140592393226071:140592393226071:61:1:1146655:1918213:0,89:140592393224090:140592393224090:61:1:1146655:1918213:0,
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 choose bk_max[70] lver 1918213 mbal 140592393226071 bal 140592393226071 inp 61 1 1146655
>2023-03-27 21:12:23 1146528 [26765]: s2:r5 ballot 1918213 phase2 write bal 140592393228058 inp 61 1 1146655 q_max 70
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 ballot 1918213 phase2 read 1:140592393226002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0,
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 ballot 1918213 phase2 read 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393226060:140592393226060:61:1:1146655:1918213:0,60:140592393226061:0:0:0:0:1918213:0,
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 ballot 1918213 phase2 read 63:140592393226064:0:0:0:0:1918213:0,70:140592393226071:140592393226071:61:1:1146655:1918213:0,89:140592393226090:0:0:0:0:1918213:0,
>2023-03-27 21:12:23 1146529 [31507]: s1:r2 acquire_disk rv -243 lver 1886509 at 1146639
>2023-03-27 21:12:23 1146529 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:12:23 1146529 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:12:23 1146529 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:12:23 1146529 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:23 1146529 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 ballot 1918213 commit other owner 61 1 1146655
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 acquire_disk rv -245 lver 1918213 at 1146655
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 acquire_token held error -245
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:23 1146529 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -245 lease owned by other host
>2023-03-27 21:12:23 1146529 [26765]: cmd_acquire 3,10,14028 result -245 pid_dead 0
>2023-03-27 21:12:24 1146530 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:12:24 1146530 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:24 1146530 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:24 1146530 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:25 1146530 [26765]: s2:r5 leader 1918213 dblocks 1:140592393228002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0,
>2023-03-27 21:12:25 1146530 [26765]: s2:r5 leader 1918213 dblocks 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393228060:0:0:0:0:1918213:0,60:140592393228061:0:0:0:0:1918213:0,
>2023-03-27 21:12:25 1146530 [26765]: s2:r5 leader 1918213 owner 61 1 1146655 dblocks 63:140592393226064:0:0:0:0:1918213:0,70:140592393228071:140592393228071:61:1:1146655:1918213:0,89:140592393226090:0:0:0:0:1918213:0,
>2023-03-27 21:12:25 1146530 [26765]: s2:r5 paxos_acquire leader 1918213 owner 61 1 1146655 max mbal[70] 140592393228071 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:25 1146530 [26765]: s2:r5 paxos_acquire owner 61 1 1146655 host_status 61 1 1146607 wait_start 1146509
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 paxos_acquire owner 61 delta 61 1 1146648 alive
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 acquire_disk rv -243 lver 1918213 at 1146655
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:25 1146531 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:25 1146531 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0,
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,50:4379894051:4379894051:92:1:1146639:1886509:0,
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 leader 1886509 dblocks 58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,82:4379892083:0:0:0:0:1886509:0,
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0,
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 4379892066 0 0 0 0 1886509
>2023-03-27 21:12:25 1146531 [31507]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146596 wait_start 1146495
>2023-03-27 21:12:26 1146532 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 leader 1918213 dblocks 1:140592393228002:0:0:0:0:1918213:0,8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0,
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 leader 1918213 dblocks 55:140592393222056:0:0:0:0:1918213:0,56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393228060:0:0:0:0:1918213:0,
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 leader 1918213 dblocks 60:140592393228061:0:0:0:0:1918213:1,63:140592393230064:140592393230064:64:1:1146859:1918214:0,70:140592393228071:140592393228071:61:1:1146655:1918213:0,89:140592393226090:0:0:0:0:1918213:0,
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 leader 1918213 owner 61 1 1146655 dblocks 97:140592393230098:0:0:0:0:1918214:0,
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 paxos_acquire leader 1918213 owner 61 1 1146655 max mbal[97] 140592393230098 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:26 1146532 [26765]: s2:r5 paxos_acquire owner 61 1 1146655 host_status 61 1 1146607 wait_start 1146509
>2023-03-27 21:12:27 1146532 [26765]: s2:r5 paxos_acquire owner 61 delta 61 1 1146648 alive
>2023-03-27 21:12:27 1146532 [26765]: s2:r5 paxos_acquire owner 61 1 1146655 writer 71 owner dblock released
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 paxos_acquire leader 1918214 owner 64 1 1146859
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 paxos_acquire 1918214 owner is 64 1 1146859
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 acquire_disk rv -244 lver 1918214 at 1146859
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 acquire_token held error -244
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:27 1146533 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -244 lease owned by other host
>2023-03-27 21:12:27 1146533 [26765]: cmd_acquire 3,10,14028 result -244 pid_dead 0
>2023-03-27 21:12:27 1146533 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive
>2023-03-27 21:12:28 1146534 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:28 1146534 [31507]: s1:r2 acquire_disk rv -243 lver 1886509 at 1146639
>2023-03-27 21:12:28 1146534 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:12:28 1146534 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:12:28 1146534 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:12:28 1146534 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:28 1146534 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 leader 1918214 dblocks 8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0,
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 leader 1918214 owner 64 1 1146859 dblocks 59:140592393230060:0:0:0:0:1918214:0,63:140592393230064:140592393230064:64:1:1146859:1918214:0,97:140592393230098:140592393230098:64:1:1146859:1918214:0,
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[97] 140592393230098 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 paxos_acquire owner 64 1 1146859 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 acquire_disk rv -243 lver 1918214 at 1146859
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:28 1146534 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:28 1146534 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:29 1146535 [14096]: s1 delta_renew begin read
>2023-03-27 21:12:29 1146535 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:12:29 1146535 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:29 1146535 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:29 1146535 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:30 1146535 [26765]: s2:r5 leader 1918214 dblocks 8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0,
>2023-03-27 21:12:30 1146535 [26765]: s2:r5 leader 1918214 owner 64 1 1146859 dblocks 59:140592393230060:0:0:0:0:1918214:0,63:140592393230064:140592393230064:64:1:1146859:1918214:0,97:140592393230098:140592393230098:64:1:1146859:1918214:0,
>2023-03-27 21:12:30 1146535 [26765]: s2:r5 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[97] 140592393230098 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:30 1146535 [26765]: s2:r5 paxos_acquire owner 64 1 1146859 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:30 1146536 [14096]: s1 delta_renew begin write for new ts 1146536
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 acquire_disk rv -243 lver 1918214 at 1146859
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:30 1146536 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:30 1146536 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0,
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,50:4379894051:4379894051:92:1:1146639:1886509:0,
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 leader 1886509 dblocks 58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,82:4379892083:0:0:0:0:1886509:0,
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0,
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 4379892066 0 0 0 0 1886509
>2023-03-27 21:12:30 1146536 [31507]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146596 wait_start 1146495
>2023-03-27 21:12:31 1146537 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:31 1146537 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:31 1146537 [26765]: s2:r5 leader 1918214 dblocks 8:140592393232009:0:0:0:0:1918215:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0,
>2023-03-27 21:12:31 1146537 [26765]: s2:r5 leader 1918214 owner 64 1 1146859 dblocks 59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:0:0:0:0:1918215:0,97:140592393230098:140592393230098:64:1:1146859:1918214:0,
>2023-03-27 21:12:31 1146537 [26765]: s2:r5 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[63] 140592393232064 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:31 1146537 [26765]: s2:r5 paxos_acquire owner 64 1 1146859 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:31 1146537 [14096]: s1 renewed 1146536 delta_length 2 interval 42
>2023-03-27 21:12:32 1146537 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:32 1146537 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive
>2023-03-27 21:12:32 1146538 [26765]: s2:r5 acquire_disk rv -243 lver 1918214 at 1146859
>2023-03-27 21:12:32 1146538 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:32 1146538 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:32 1146538 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:32 1146538 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:32 1146538 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:33 1146539 [31507]: s1:r2 paxos_acquire owner 92 1 1146639 writer 59 owner dblock released
>2023-03-27 21:12:33 1146539 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 leader 1918215 owner 64 1 1146865 dblocks 8:140592393234009:140592393234009:64:1:1146865:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0,
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 paxos_acquire leader 1918215 owner 64 1 1146865 max mbal[8] 140592393234009 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 paxos_acquire owner 64 1 1146865 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 acquire_disk rv -243 lver 1918215 at 1146865
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:33 1146539 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:33 1146539 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:34 1146540 [31507]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639
>2023-03-27 21:12:34 1146540 [31507]: s1:r2 ballot 1886510 phase1 write mbal 4379896066
>2023-03-27 21:12:34 1146540 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:34 1146540 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:35 1146540 [26765]: s2:r5 leader 1918215 owner 64 1 1146865 dblocks 8:140592393234009:140592393234009:64:1:1146865:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0,
>2023-03-27 21:12:35 1146540 [26765]: s2:r5 paxos_acquire leader 1918215 owner 64 1 1146865 max mbal[8] 140592393234009 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:35 1146540 [26765]: s2:r5 paxos_acquire owner 64 1 1146865 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 acquire_disk rv -243 lver 1918215 at 1146865
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:35 1146541 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:35 1146541 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:36 1146542 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:36 1146542 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:36 1146542 [26765]: s2:r5 leader 1918215 owner 64 1 1146865 dblocks 8:140592393234009:140592393234009:64:1:1146865:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393236064:0:0:0:0:1918216:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0,
>2023-03-27 21:12:36 1146542 [26765]: s2:r5 paxos_acquire leader 1918215 owner 64 1 1146865 max mbal[63] 140592393236064 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:36 1146542 [26765]: s2:r5 paxos_acquire owner 64 1 1146865 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 acquire_disk rv -243 lver 1918215 at 1146865
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:37 1146542 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:37 1146542 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:37 1146543 [31507]: s1:r2 ballot 1886510 phase1 read 20:4379896021:0:0:0:0:1886510:0,45:4379896046:0:0:0:0:1886510:0,65:4379896066:0:0:0:0:1886510:0,
>2023-03-27 21:12:37 1146543 [31507]: s1:r2 ballot 1886510 phase2 write bal 4379896066 inp 66 1 1146543 q_max -1
>2023-03-27 21:12:38 1146543 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:38 1146543 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 leader 1918216 owner 64 1 1146870 dblocks 1:140592393236002:0:0:0:0:1918216:0,35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0,
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 acquire_disk rv -243 lver 1918216 at 1146870
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:38 1146544 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:38 1146544 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:39 1146545 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:39 1146545 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:40 1146545 [31507]: s1:r2 ballot 1886510 phase2 read 12:4379896013:0:0:0:0:1886510:0,20:4379896021:0:0:0:0:1886510:0,44:4379896045:0:0:0:0:1886510:0,45:4379896046:0:0:0:0:1886510:0,
>2023-03-27 21:12:40 1146545 [31507]: s1:r2 ballot 1886510 abort2 larger mbal in bk[80] 4379896081:0:0:0:0:1886510 our dblock 4379896066:4379896066:66:1:1146543:1886510
>2023-03-27 21:12:40 1146545 [31507]: s1:r2 ballot 1886510 phase2 read 65:4379896066:4379896066:66:1:1146543:1886510:0,80:4379896081:0:0:0:0:1886510:0,
>2023-03-27 21:12:40 1146545 [31507]: s1:r2 paxos_acquire 1886510 retry delay 684582 us
>2023-03-27 21:12:40 1146545 [26765]: s2:r5 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0,
>2023-03-27 21:12:40 1146545 [26765]: s2:r5 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:40 1146545 [26765]: s2:r5 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 acquire_disk rv -243 lver 1918216 at 1146870
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:40 1146546 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:40 1146546 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:41 1146547 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:41 1146547 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:41 1146547 [26765]: s2:r5 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0,
>2023-03-27 21:12:41 1146547 [26765]: s2:r5 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:41 1146547 [26765]: s2:r5 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:42 1146547 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146835 alive
>2023-03-27 21:12:42 1146548 [31507]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639
>2023-03-27 21:12:42 1146548 [31507]: s1:r2 ballot 1886510 phase1 write mbal 4379898066
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 acquire_disk rv -243 lver 1918216 at 1146870
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:42 1146548 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:42 1146548 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0,
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393228058 140592393228058 61 1 1146655 1918213
>2023-03-27 21:12:42 1146548 [26765]: s2:r5 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146509
>2023-03-27 21:12:43 1146549 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:43 1146549 [26765]: s2:r5 paxos_acquire owner 64 1 1146870 writer 71 owner dblock released
>2023-03-27 21:12:43 1146549 [26765]: s2:r5 paxos_acquire leader 1918216 owner 64 1 1146870
>2023-03-27 21:12:43 1146549 [26765]: s2:r5 ballot 1918217 phase1 write mbal 140592393238058
>2023-03-27 21:12:44 1146550 [26765]: s2:r5 ballot 1918217 phase1 read 1:140592393238002:0:0:0:0:1918217:0,28:140592393238029:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393238056:0:0:0:0:1918217:0,
>2023-03-27 21:12:44 1146550 [26765]: s2:r5 ballot 1918217 abort1 larger mbal in bk[63] 140592393238064:140592393238064:64:1:1146877:1918217 our dblock 140592393238058:0:0:0:0:1918217
>2023-03-27 21:12:44 1146550 [26765]: s2:r5 ballot 1918217 phase1 read 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:44 1146550 [26765]: s2:r5 paxos_acquire 1918217 retry delay 943141 us
>2023-03-27 21:12:44 1146550 [18825]: s2 delta_renew begin read
>2023-03-27 21:12:44 1146550 [18825]: s2 delta_renew begin write for new ts 1146550
>2023-03-27 21:12:45 1146550 [18825]: s2 renewed 1146550 delta_length 0 interval 41
>2023-03-27 21:12:45 1146551 [31507]: s1:r2 ballot 1886510 phase1 read 12:4379896013:0:0:0:0:1886510:0,20:4379898021:0:0:0:0:1886510:0,39:4379896040:0:0:0:0:1886510:0,44:4379898045:0:0:0:0:1886510:0,
>2023-03-27 21:12:45 1146551 [31507]: s1:r2 ballot 1886510 phase1 read 45:4379898046:0:0:0:0:1886510:0,46:4379896047:0:0:0:0:1886510:0,50:4379896051:0:0:0:0:1886510:0,65:4379898066:0:0:0:0:1886510:0,
>2023-03-27 21:12:45 1146551 [31507]: s1:r2 ballot 1886510 abort1 larger mbal in bk[80] 4379898081:0:0:0:0:1886510 our dblock 4379898066:0:0:0:0:1886510
>2023-03-27 21:12:45 1146551 [31507]: s1:r2 ballot 1886510 phase1 read 71:4379896072:0:0:0:0:1886510:0,80:4379898081:0:0:0:0:1886510:0,
>2023-03-27 21:12:45 1146551 [31507]: s1:r2 paxos_acquire 1886510 retry delay 739602 us
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 paxos_acquire 1918217 owner is 64 1 1146877
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 acquire_disk rv -244 lver 1918217 at 1146877
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 acquire_token held error -244
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:45 1146551 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -244 lease owned by other host
>2023-03-27 21:12:45 1146551 [26765]: cmd_acquire 3,10,14028 result -244 pid_dead 0
>2023-03-27 21:12:46 1146552 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:46 1146552 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:46 1146552 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:46 1146552 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:46 1146552 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:46 1146552 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:47 1146552 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:47 1146553 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:47 1146553 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:47 1146553 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:47 1146553 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:47 1146553 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:47 1146553 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:47 1146553 [31507]: s1:r2 paxos_acquire leader 1886510 owner 66 1 1146543
>2023-03-27 21:12:47 1146553 [31507]: s1:r2 paxos_acquire 1886510 owner is our inp 66 1 1146543 committed by 92
>2023-03-27 21:12:47 1146553 [31507]: s1:r2 acquire_disk rv 1 lver 1886510 at 1146543
>2023-03-27 21:12:48 1146554 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:48 1146554 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:49 1146554 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:49 1146554 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:49 1146554 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:49 1146554 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:49 1146554 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:49 1146554 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:49 1146555 [31507]: cmd_acquire 2,9,14028 result 0 pid_dead 0
>2023-03-27 21:12:49 1146555 [26765]: cmd_get_lvb ci 4 fd 12 result 0 res lvm_98e69d79725f49e2bcafdcd2f1a5ff9c:VGLK
>2023-03-27 21:12:50 1146555 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:50 1146555 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:50 1146556 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:50 1146556 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:51 1146557 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:51 1146557 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:52 1146558 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:52 1146558 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:53 1146559 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:53 1146559 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:54 1146559 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:54 1146559 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:54 1146559 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:54 1146559 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:54 1146560 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:54 1146560 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:55 1146561 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:55 1146561 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:55 1146561 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:55 1146561 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:55 1146561 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:55 1146561 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:56 1146561 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:56 1146562 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:56 1146562 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:56 1146562 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:56 1146562 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:56 1146562 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:56 1146562 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:57 1146563 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:57 1146563 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:12:57 1146563 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:12:57 1146563 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:12:57 1146563 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:12:57 1146563 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:12:58 1146563 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:12:58 1146564 [31507]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:12:58 1146564 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:12:58 1146564 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:12:58 1146564 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:12:58 1146564 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:12:58 1146564 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:12:59 1146565 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:12:59 1146565 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:00 1146565 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:00 1146565 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:00 1146565 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:00 1146565 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:00 1146566 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:01 1146567 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:13:01 1146567 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:01 1146567 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:01 1146567 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:01 1146567 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:01 1146567 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:02 1146568 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:02 1146568 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:03 1146569 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:03 1146569 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:03 1146569 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:03 1146569 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:04 1146570 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:05 1146571 [31507]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:13:05 1146571 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:05 1146571 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:05 1146571 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:05 1146571 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:05 1146571 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:06 1146572 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:06 1146572 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:08 1146573 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:08 1146573 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:08 1146573 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:08 1146573 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:09 1146575 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:11 1146577 [14096]: s1 delta_renew begin read
>2023-03-27 21:13:11 1146577 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:13:11 1146577 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:11 1146577 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:11 1146577 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:11 1146577 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:11 1146577 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:12 1146578 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:12 1146578 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:12 1146578 [14096]: s1 delta_renew begin write for new ts 1146578
>2023-03-27 21:13:13 1146579 [14096]: s1 renewed 1146578 delta_length 2 interval 42
>2023-03-27 21:13:14 1146580 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:14 1146580 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:14 1146580 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:14 1146580 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:16 1146581 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:17 1146583 [31507]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:13:17 1146583 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:17 1146583 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:17 1146583 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:17 1146583 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:17 1146583 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:17 1146583 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:17 1146583 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:19 1146584 [26765]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:19 1146584 [26765]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:19 1146584 [26765]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:19 1146584 [26765]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:19 1146585 [26765]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:20 1146586 [26765]: s2:r5 acquire_disk rv -243 lver 1918217 at 1146877
>2023-03-27 21:13:20 1146586 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:20 1146586 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:20 1146586 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:20 1146586 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:20 1146586 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:21 1146587 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:21 1146587 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0,
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0,
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393238058 0 0 0 0 1918217
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146550
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 paxos_acquire owner 64 delta 64 1 1146876 alive
>2023-03-27 21:13:22 1146588 [31507]: s2:r5 paxos_acquire owner 64 1 1146877 writer 56 owner dblock released
>2023-03-27 21:13:23 1146588 [31507]: s2:r5 paxos_acquire leader 1918217 owner 64 1 1146877
>2023-03-27 21:13:23 1146588 [31507]: s2:r5 ballot 1918218 phase1 write mbal 140592393242058
>2023-03-27 21:13:23 1146589 [31507]: s2:r5 ballot 1918218 phase1 read 8:140592393242009:0:0:0:0:1918218:0,57:140592393242058:0:0:0:0:1918218:0,
>2023-03-27 21:13:23 1146589 [31507]: s2:r5 ballot 1918218 phase2 write bal 140592393242058 inp 58 1 1146589 q_max -1
>2023-03-27 21:13:24 1146589 [31507]: s2:r5 ballot 1918218 phase2 read 8:140592393242009:0:0:0:0:1918218:0,57:140592393242058:140592393242058:58:1:1146589:1918218:0,
>2023-03-27 21:13:24 1146590 [31507]: s2:r5 ballot 1918218 commit self owner 58 1 1146589
>2023-03-27 21:13:24 1146590 [31507]: s2:r5 acquire_disk rv 1 lver 1918218 at 1146589
>2023-03-27 21:13:24 1146590 [31507]: cmd_acquire 3,10,14028 result 0 pid_dead 0
>2023-03-27 21:13:24 1146590 [26765]: cmd_get_lvb ci 4 fd 12 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK
>2023-03-27 21:13:25 1146591 [18825]: s2 delta_renew begin read
>2023-03-27 21:13:25 1146591 [18825]: s2 delta_renew begin write for new ts 1146591
>2023-03-27 21:13:25 1146591 [18825]: s2 renewed 1146591 delta_length 0 interval 41
>2023-03-27 21:13:27 1146593 [31507]: cmd_release 3,10,14028 ci_in 3 fd 10 count 1 flags 0
>2023-03-27 21:13:27 1146593 [31507]: s2:r5 release_token r_flags 8 lver 1918218
>2023-03-27 21:13:27 1146593 [31507]: s2:r5 write_host_block host_id 58 flags 0 gen 0 dblock 140592393242058:140592393242058:58:1:1146589:1918218:RELEASED.
>2023-03-27 21:13:27 1146593 [31507]: s2:r5 paxos_release leader 1918218 owner 58 1 1146589
>2023-03-27 21:13:27 1146593 [31507]: s2:r5 paxos_release skip write last lver 1918218 owner 58 1 1146589 writer 58 1 1146589 disk lver 1918218 owner 58 1 1146589 writer 61 1 1146721
>2023-03-27 21:13:27 1146593 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:27 1146593 [31507]: cmd_release 3,10,14028 result 0 pid_dead 0 count 1
>2023-03-27 21:13:27 1146593 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:27 1146593 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:28 1146593 [26765]: s2:r5 leader 1918218 owner 58 1 1146589 dblocks 57:140592393242058:140592393242058:58:1:1146589:1918218:1,59:140592393242060:0:0:0:0:1918218:0,60:140592393242061:140592393242061:58:1:1146589:1918218:0,70:140592393244071:0:0:0:0:1918219:0,
>2023-03-27 21:13:28 1146593 [26765]: s2:r5 paxos_acquire leader 1918218 owner 58 1 1146589 max mbal[70] 140592393244071 our_dblock 140592393242058 140592393242058 58 1 1146589 1918218
>2023-03-27 21:13:28 1146593 [26765]: s2:r5 paxos_acquire owner 58 1 1146589 is already local 58 1
>2023-03-27 21:13:28 1146593 [26765]: s2:r5 ballot 1918219 phase1 write mbal 140592393246058
>2023-03-27 21:13:28 1146594 [26765]: s2:r5 ballot 1918219 phase1 read 1:140592393244002:0:0:0:0:1918219:0,8:140592393244009:0:0:0:0:1918219:0,57:140592393246058:0:0:0:0:1918219:0,70:140592393244071:140592393244071:71:1:1146528:1918219:0,
>2023-03-27 21:13:28 1146594 [26765]: s2:r5 ballot 1918219 phase1 read 89:140592393244090:0:0:0:0:1918219:0,
>2023-03-27 21:13:28 1146594 [26765]: s2:r5 ballot 1918219 choose bk_max[70] lver 1918219 mbal 140592393244071 bal 140592393244071 inp 71 1 1146528
>2023-03-27 21:13:28 1146594 [26765]: s2:r5 ballot 1918219 phase2 write bal 140592393246058 inp 71 1 1146528 q_max 70
>2023-03-27 21:13:29 1146595 [26765]: s2:r5 ballot 1918219 phase2 read 1:140592393244002:0:0:0:0:1918219:0,8:140592393244009:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393244061:0:0:0:0:1918219:0,
>2023-03-27 21:13:29 1146595 [26765]: s2:r5 ballot 1918219 abort2 larger mbal in bk[89] 140592393246090:0:0:0:0:1918219 our dblock 140592393246058:140592393246058:71:1:1146528:1918219
>2023-03-27 21:13:29 1146595 [26765]: s2:r5 ballot 1918219 phase2 read 70:140592393244071:140592393244071:71:1:1146528:1918219:0,89:140592393246090:0:0:0:0:1918219:0,
>2023-03-27 21:13:29 1146595 [26765]: s2:r5 paxos_acquire 1918219 retry delay 788443 us
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 paxos_acquire 1918219 owner is 71 1 1146528
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 acquire_disk rv -244 lver 1918219 at 1146528
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 acquire_token held error -244
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:30 1146596 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -244 lease owned by other host
>2023-03-27 21:13:30 1146596 [26765]: cmd_acquire 3,10,14028 result -244 pid_dead 0
>2023-03-27 21:13:31 1146597 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:31 1146597 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:31 1146597 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:32 1146598 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:32 1146598 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:33 1146598 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:33 1146598 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:33 1146598 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:33 1146598 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:33 1146599 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:33 1146599 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:34 1146600 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:34 1146600 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:34 1146600 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:34 1146600 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:34 1146600 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:34 1146600 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:35 1146600 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:35 1146600 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:36 1146601 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:36 1146601 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:36 1146602 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:36 1146602 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:36 1146602 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:36 1146602 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:36 1146602 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:37 1146602 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:37 1146602 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:37 1146602 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:37 1146602 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:37 1146602 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:37 1146602 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:38 1146603 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:38 1146603 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:38 1146604 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:38 1146604 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:38 1146604 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:38 1146604 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:38 1146604 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:39 1146604 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:39 1146604 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:39 1146604 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:39 1146604 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:39 1146604 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:39 1146604 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:40 1146605 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:40 1146605 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:40 1146606 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:40 1146606 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:40 1146606 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:40 1146606 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:40 1146606 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:41 1146606 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:41 1146606 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:41 1146606 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:41 1146606 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:41 1146606 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:41 1146606 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:42 1146607 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:42 1146607 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:42 1146608 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:42 1146608 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:42 1146608 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:42 1146608 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:42 1146608 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:43 1146609 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:43 1146609 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:43 1146609 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:43 1146609 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:43 1146609 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:43 1146609 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:44 1146610 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:44 1146610 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:45 1146611 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:45 1146611 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:45 1146611 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:45 1146611 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:45 1146611 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:45 1146611 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:46 1146612 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:46 1146612 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:46 1146612 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:46 1146612 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:46 1146612 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:46 1146612 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:47 1146612 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:47 1146613 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:47 1146613 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:47 1146613 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:47 1146613 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:47 1146613 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:47 1146613 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:48 1146614 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:48 1146614 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:49 1146614 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:49 1146614 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:49 1146614 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:49 1146614 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:49 1146615 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:49 1146615 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:50 1146616 [31507]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:50 1146616 [31507]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:51 1146617 [31507]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:51 1146617 [31507]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:51 1146617 [31507]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:51 1146617 [31507]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:52 1146618 [31507]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:53 1146618 [14096]: s1 delta_renew begin read
>2023-03-27 21:13:53 1146619 [31507]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:53 1146619 [31507]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:53 1146619 [31507]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:53 1146619 [31507]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:53 1146619 [31507]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:53 1146619 [31507]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:13:54 1146620 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:13:54 1146620 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:13:54 1146620 [14096]: s1 delta_renew begin write for new ts 1146620
>2023-03-27 21:13:55 1146621 [14096]: s1 renewed 1146620 delta_length 3 interval 42
>2023-03-27 21:13:55 1146621 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:13:55 1146621 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:13:55 1146621 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:13:55 1146621 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:13:57 1146623 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146517 alive
>2023-03-27 21:13:59 1146625 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:13:59 1146625 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:13:59 1146625 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:13:59 1146625 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:13:59 1146625 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:13:59 1146625 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:14:00 1146625 [31507]: cmd_set_lvb ci 4 fd 12 result 0 res lvm_98e69d79725f49e2bcafdcd2f1a5ff9c:VGLK
>2023-03-27 21:14:00 1146625 [26765]: cmd_release 2,9,14028 ci_in 2 fd 9 count 1 flags 0
>2023-03-27 21:14:00 1146625 [26765]: s1:r2 release_token r_flags 28 lver 1886510
>2023-03-27 21:14:00 1146626 [26765]: s1:r2 write_host_block host_id 66 flags 0 gen 0 dblock 4379898066:0:0:0:0:1886510:RELEASED.
>2023-03-27 21:14:00 1146626 [26765]: s1:r2 paxos_release leader 1886511 owner 92 1 1146756
>2023-03-27 21:14:00 1146626 [26765]: s1:r2 paxos_release skip write last lver 1886510 owner 66 1 1146543 writer 92 1 1146678 disk lver 1886511 owner 92 1 1146756 writer 45 1 1146889
>2023-03-27 21:14:00 1146626 [26765]: s1:r2 release_token done r_flags 28
>2023-03-27 21:14:00 1146626 [26765]: cmd_release 2,9,14028 result 0 pid_dead 0 count 1
>2023-03-27 21:14:00 1146626 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:14:00 1146626 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:00 1146626 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:14:00 1146626 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:01 1146626 [31507]: s1:r2 leader 1886511 dblocks 20:4379900021:0:0:0:0:1886511:0,27:4379904028:0:0:0:0:1886511:0,44:4379906045:4379906045:92:1:1146756:1886511:0,45:4379904046:0:0:0:0:1886511:0,
>2023-03-27 21:14:01 1146626 [31507]: s1:r2 leader 1886511 owner 92 1 1146756 dblocks 71:4379902072:0:0:0:0:1886511:0,80:4379902081:0:0:0:0:1886511:0,82:4379904083:0:0:0:0:1886511:0,91:4379904092:4379904092:92:1:1146756:1886511:0,
>2023-03-27 21:14:01 1146626 [31507]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 max mbal[44] 4379906045 our_dblock 4379898066 0 0 0 0 1886510
>2023-03-27 21:14:01 1146626 [31507]: s1:r2 paxos_acquire owner 92 1 1146756 host_status 92 1 1146721 wait_start 1146622
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 acquire_disk rv -243 lver 1886511 at 1146756
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:14:01 1146627 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:14:01 1146627 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:14:02 1146628 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:14:02 1146628 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:03 1146628 [31507]: s1:r2 leader 1886511 dblocks 12:4379902013:0:0:0:0:1886511:0,20:4379900021:0:0:0:0:1886511:0,27:4379904028:0:0:0:0:1886511:0,44:4379906045:4379906045:92:1:1146756:1886511:0,
>2023-03-27 21:14:03 1146628 [31507]: s1:r2 leader 1886511 dblocks 45:4379904046:0:0:0:0:1886511:0,71:4379902072:0:0:0:0:1886511:0,80:4379902081:0:0:0:0:1886511:0,82:4379904083:0:0:0:0:1886511:0,
>2023-03-27 21:14:03 1146628 [31507]: s1:r2 leader 1886511 owner 92 1 1146756 dblocks 91:4379904092:4379904092:92:1:1146756:1886511:1,
>2023-03-27 21:14:03 1146628 [31507]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 max mbal[44] 4379906045 our_dblock 4379898066 0 0 0 0 1886510
>2023-03-27 21:14:03 1146628 [31507]: s1:r2 paxos_acquire owner 92 1 1146756 host_status 92 1 1146721 wait_start 1146622
>2023-03-27 21:14:03 1146628 [26765]: s2:r5 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0,
>2023-03-27 21:14:03 1146628 [26765]: s2:r5 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0,
>2023-03-27 21:14:03 1146628 [26765]: s2:r5 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246058 140592393246058 71 1 1146528 1918219
>2023-03-27 21:14:03 1146628 [26765]: s2:r5 paxos_acquire owner 71 1 1146528 host_status 71 1 1146517 wait_start 1146591
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 acquire_disk rv -243 lver 1886511 at 1146756
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:14:03 1146629 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:14:03 1146629 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:14:04 1146630 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:14:04 1146630 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:04 1146630 [31507]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 91:4379908092:4379908092:92:1:1146760:1886512:0,
>2023-03-27 21:14:04 1146630 [31507]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 4379898066 0 0 0 0 1886510
>2023-03-27 21:14:04 1146630 [31507]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146622
>2023-03-27 21:14:04 1146630 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive
>2023-03-27 21:14:05 1146630 [31507]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760
>2023-03-27 21:14:05 1146630 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:14:05 1146630 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:14:05 1146630 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:14:05 1146630 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:14:05 1146630 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:14:05 1146631 [26765]: s2:r5 paxos_acquire owner 71 delta 71 1 1146560 alive
>2023-03-27 21:14:06 1146631 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:14:06 1146631 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:06 1146632 [18825]: s2 delta_renew begin read
>2023-03-27 21:14:06 1146632 [31507]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0,
>2023-03-27 21:14:06 1146632 [31507]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 4379898066 0 0 0 0 1886510
>2023-03-27 21:14:06 1146632 [31507]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146622
>2023-03-27 21:14:06 1146632 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive
>2023-03-27 21:14:07 1146633 [31507]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760
>2023-03-27 21:14:07 1146633 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:14:07 1146633 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:14:07 1146633 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:14:07 1146633 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:14:07 1146633 [31507]: cmd_acquire 2,9,14028 result -243 pid_dead 0
>2023-03-27 21:14:08 1146634 [31507]: cmd_acquire 2,9,14028 ci_in 2 fd 9 count 1 flags 9
>2023-03-27 21:14:08 1146634 [31507]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:08 1146634 [26765]: s2:r5 acquire_disk rv -243 lver 1918219 at 1146528
>2023-03-27 21:14:08 1146634 [26765]: s2:r5 acquire_token held error -243
>2023-03-27 21:14:08 1146634 [26765]: s2:r5 release_token r_flags 8 lver 0
>2023-03-27 21:14:08 1146634 [26765]: s2:r5 release_token done r_flags 8
>2023-03-27 21:14:08 1146634 [26765]: s2:r5 cmd_acquire 3,10,14028 acquire_token -243 lease owned by other host
>2023-03-27 21:14:08 1146634 [26765]: cmd_acquire 3,10,14028 result -243 pid_dead 0
>2023-03-27 21:14:08 1146634 [31507]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0,
>2023-03-27 21:14:08 1146634 [31507]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 4379898066 0 0 0 0 1886510
>2023-03-27 21:14:08 1146634 [31507]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146622
>2023-03-27 21:14:08 1146634 [18825]: s2 delta_renew begin write for new ts 1146634
>2023-03-27 21:14:09 1146634 [31507]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive
>2023-03-27 21:14:09 1146635 [26765]: cmd_acquire 3,10,14028 ci_in 3 fd 10 count 1 flags 9
>2023-03-27 21:14:09 1146635 [26765]: s2:r5 paxos_acquire begin offset 69206016 0xa 512 1048576
>2023-03-27 21:14:09 1146635 [31507]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760
>2023-03-27 21:14:09 1146635 [31507]: s1:r2 acquire_token held error -243
>2023-03-27 21:14:09 1146635 [31507]: s1:r2 release_token r_flags 8 lver 0
>2023-03-27 21:14:09 1146635 [31507]: s1:r2 release_token done r_flags 8
>2023-03-27 21:14:09 1146635 [31507]: s1:r2 cmd_acquire 2,9,14028 acquire_token -243 lease owned by other host

Actions: View

Attachments on bug 2176424: 1948968 | 1949192 | 1949193 | 1949194 | 1949197 | 1949823 | 1954340 | 1954341 | 1957424 | 1957425