Login
Log in using an SSO provider:
Fedora Account System
Red Hat Associate
Red Hat Customer
Login using a Red Hat Bugzilla account
Forgot Password
Create an Account
Red Hat Bugzilla – Attachment 1957425 Details for
Bug 2176424
Checksum error at offset
Home
New
Search
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh90 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
[?]
This site requires JavaScript to be enabled to function correctly, please enable it.
host-40-sanljock.log
host-40-sanlock.log (text/plain), 113.02 KB, created by
shan.wu
on 2023-04-14 02:20:21 UTC
(
hide
)
Description:
host-40-sanljock.log
Filename:
MIME Type:
Creator:
shan.wu
Created:
2023-04-14 02:20:21 UTC
Size:
113.02 KB
patch
obsolete
>2023-03-27 21:11:58 1146438 [3645]: s2:r4 paxos_acquire leader 1918207 owner 71 1 1146431 max mbal[96] 140592393200097 our_dblock 140592393196071 140592393196071 71 1 1146431 1918207 >2023-03-27 21:11:58 1146438 [3645]: s2:r4 paxos_acquire owner 71 1 1146431 is already local 71 1 >2023-03-27 21:11:58 1146438 [3645]: s2:r4 ballot 1918208 phase1 write mbal 140592393202071 >2023-03-27 21:11:59 1146438 [30594]: s1:r2 paxos_acquire owner 91 delta 91 2 1147055 alive >2023-03-27 21:11:59 1146439 [3645]: s2:r4 ballot 1918208 phase1 read 1:140592393200002:0:0:0:0:1918208:0,35:140592393200036:0:0:0:0:1918208:0,55:140592393200056:0:0:0:0:1918208:0,56:140592393200057:0:0:0:0:1918208:0, >2023-03-27 21:11:59 1146439 [3645]: s2:r4 ballot 1918208 phase1 read 60:140592393200061:0:0:0:0:1918208:0,70:140592393202071:0:0:0:0:1918208:0,89:140592393200090:0:0:0:0:1918208:0,96:140592393200097:0:0:0:0:1918208:0, >2023-03-27 21:11:59 1146439 [3645]: s2:r4 ballot 1918208 phase1 read 97:140592393200098:0:0:0:0:1918208:0, >2023-03-27 21:11:59 1146439 [3645]: s2:r4 ballot 1918208 phase2 write bal 140592393202071 inp 71 1 1146439 q_max -1 >2023-03-27 21:12:00 1146439 [3645]: s2:r4 ballot 1918208 phase2 read 1:140592393200002:0:0:0:0:1918208:0,26:140592393200027:0:0:0:0:1918208:0,28:140592393200029:0:0:0:0:1918208:0,35:140592393200036:0:0:0:0:1918208:0, >2023-03-27 21:12:00 1146439 [3645]: s2:r4 ballot 1918208 phase2 read 54:140592393200055:0:0:0:0:1918208:0,55:140592393200056:0:0:0:0:1918208:0,56:140592393200057:0:0:0:0:1918208:0,60:140592393200061:0:0:0:0:1918208:0, >2023-03-27 21:12:00 1146439 [3645]: s2:r4 ballot 1918208 phase2 read 70:140592393202071:140592393202071:71:1:1146439:1918208:0,89:140592393200090:0:0:0:0:1918208:0,96:140592393200097:0:0:0:0:1918208:0,97:140592393200098:0:0:0:0:1918208:0, >2023-03-27 21:12:00 1146440 [30594]: s1:r2 paxos_acquire owner 91 2 1146970 writer 92 owner dblock released >2023-03-27 21:12:00 1146440 [3645]: s2:r4 ballot 1918208 commit self owner 71 1 1146439 >2023-03-27 21:12:00 1146440 [3645]: s2:r4 acquire_disk rv 1 lver 1918208 at 1146439 >2023-03-27 21:12:00 1146440 [3645]: cmd_acquire 3,10,12513 result 0 pid_dead 0 >2023-03-27 21:12:00 1146440 [3645]: cmd_get_lvb ci 4 fd 12 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK >2023-03-27 21:12:01 1146441 [30594]: s1:r2 paxos_acquire leader 1886508 owner 91 2 1146970 >2023-03-27 21:12:01 1146441 [30594]: s1:r2 ballot 1886509 phase1 write mbal 4379888101 >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 phase1 read 12:4379888013:0:0:0:0:1886509:0,20:4379888021:0:0:0:0:1886509:0,27:4379888028:0:0:0:0:1886509:0,31:4379888032:0:0:0:0:1886509:0, >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 phase1 read 39:4379888040:0:0:0:0:1886509:0,44:4379888045:0:0:0:0:1886509:0,45:4379888046:0:0:0:0:1886509:0,46:4379888047:0:0:0:0:1886509:0, >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 phase1 read 50:4379888051:0:0:0:0:1886509:0,58:4379888059:0:0:0:0:1886509:0,65:4379888066:0:0:0:0:1886509:0,80:4379888081:0:0:0:0:1886509:0, >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 phase1 read 82:4379888083:0:0:0:0:1886509:0,91:4379888092:4379888092:92:1:1146639:1886509:0,100:4379888101:0:0:0:0:1886509:0, >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 choose bk_max[91] lver 1886509 mbal 4379888092 bal 4379888092 inp 92 1 1146639 >2023-03-27 21:12:03 1146443 [30594]: s1:r2 ballot 1886509 phase2 write bal 4379888101 inp 92 1 1146639 q_max 91 >2023-03-27 21:12:04 1146443 [3645]: cmd_release 3,10,12513 ci_in 3 fd 10 count 1 flags 0 >2023-03-27 21:12:04 1146443 [3645]: s2:r4 release_token r_flags 8 lver 1918208 >2023-03-27 21:12:04 1146444 [3645]: s2:r4 write_host_block host_id 71 flags 0 gen 0 dblock 140592393202071:140592393202071:71:1:1146439:1918208:RELEASED. >2023-03-27 21:12:04 1146444 [3645]: s2:r4 paxos_release leader 1918208 owner 71 1 1146439 >2023-03-27 21:12:04 1146444 [3645]: s2:r4 paxos_release skip write last lver 1918208 owner 71 1 1146439 writer 71 1 1146439 disk lver 1918208 owner 71 1 1146439 writer 98 1 1147560 >2023-03-27 21:12:04 1146444 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:04 1146444 [3645]: cmd_release 3,10,12513 result 0 pid_dead 0 count 1 >2023-03-27 21:12:04 1146444 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:04 1146444 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:05 1146444 [3645]: s2:r4 leader 1918208 dblocks 1:140592393202002:0:0:0:0:1918208:0,26:140592393200027:0:0:0:0:1918208:0,28:140592393202029:0:0:0:0:1918208:0,35:140592393202036:0:0:0:0:1918208:0, >2023-03-27 21:12:05 1146444 [3645]: s2:r4 leader 1918208 dblocks 54:140592393202055:0:0:0:0:1918208:0,55:140592393202056:0:0:0:0:1918208:0,56:140592393202057:0:0:0:0:1918208:0,57:140592393204058:0:0:0:0:1918209:0, >2023-03-27 21:12:05 1146444 [3645]: s2:r4 leader 1918208 owner 71 1 1146439 dblocks 60:140592393202061:0:0:0:0:1918208:0,70:140592393202071:140592393202071:71:1:1146439:1918208:1,89:140592393202090:0:0:0:0:1918208:0,97:140592393202098:140592393202098:71:1:1146439:1918208:0, >2023-03-27 21:12:05 1146444 [3645]: s2:r4 paxos_acquire leader 1918208 owner 71 1 1146439 max mbal[57] 140592393204058 our_dblock 140592393202071 140592393202071 71 1 1146439 1918208 >2023-03-27 21:12:05 1146444 [3645]: s2:r4 paxos_acquire owner 71 1 1146439 is already local 71 1 >2023-03-27 21:12:05 1146444 [3645]: s2:r4 ballot 1918209 phase1 write mbal 140592393206071 >2023-03-27 21:12:05 1146445 [3645]: s2:r4 ballot 1918209 phase1 read 1:140592393204002:0:0:0:0:1918209:0,8:140592393204009:0:0:0:0:1918209:0,57:140592393204058:0:0:0:0:1918209:0,59:140592393204060:0:0:0:0:1918209:0, >2023-03-27 21:12:05 1146445 [3645]: s2:r4 ballot 1918209 phase1 read 60:140592393204061:0:0:0:0:1918209:0,70:140592393206071:0:0:0:0:1918209:0,96:140592393204097:140592393204097:97:1:1147629:1918209:0, >2023-03-27 21:12:05 1146445 [3645]: s2:r4 ballot 1918209 choose bk_max[96] lver 1918209 mbal 140592393204097 bal 140592393204097 inp 97 1 1147629 >2023-03-27 21:12:05 1146445 [3645]: s2:r4 ballot 1918209 phase2 write bal 140592393206071 inp 97 1 1147629 q_max 96 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 ballot 1918209 phase2 read 1:140592393206002:0:0:0:0:1918209:0,8:140592393204009:0:0:0:0:1918209:0,28:140592393204029:0:0:0:0:1918209:0,54:140592393204055:0:0:0:0:1918209:0, >2023-03-27 21:12:06 1146446 [3645]: s2:r4 ballot 1918209 phase2 read 57:140592393204058:0:0:0:0:1918209:0,59:140592393204060:0:0:0:0:1918209:0,60:140592393204061:0:0:0:0:1918209:0,70:140592393206071:140592393206071:97:1:1147629:1918209:0, >2023-03-27 21:12:06 1146446 [3645]: s2:r4 ballot 1918209 phase2 read 96:140592393204097:140592393204097:97:1:1147629:1918209:0, >2023-03-27 21:12:06 1146446 [30594]: s1:r2 ballot 1886509 abort2 larger mbal in bk[20] 4379890021:0:0:0:0:1886509 our dblock 4379888101:4379888101:92:1:1146639:1886509 >2023-03-27 21:12:06 1146446 [30594]: s1:r2 ballot 1886509 phase2 read 12:4379888013:0:0:0:0:1886509:0,20:4379890021:0:0:0:0:1886509:0, >2023-03-27 21:12:06 1146446 [30594]: s1:r2 paxos_acquire 1886509 retry delay 52365 us >2023-03-27 21:12:06 1146446 [3645]: s2:r4 ballot 1918209 commit other owner 97 1 1147629 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 acquire_disk rv -245 lver 1918209 at 1147629 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 acquire_token held error -245 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:06 1146446 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -245 lease owned by other host >2023-03-27 21:12:06 1146446 [3645]: cmd_acquire 3,10,12513 result -245 pid_dead 0 >2023-03-27 21:12:07 1146447 [30594]: s1:r2 paxos_acquire leader 1886508 owner 91 2 1146970 >2023-03-27 21:12:07 1146447 [30594]: s1:r2 ballot 1886509 phase1 write mbal 4379890101 >2023-03-27 21:12:07 1146447 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:07 1146447 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:07 1146447 [3645]: s2:r4 leader 1918209 dblocks 1:140592393206002:0:0:0:0:1918209:0,8:140592393206009:0:0:0:0:1918209:0,28:140592393204029:0:0:0:0:1918209:0,54:140592393204055:0:0:0:0:1918209:0, >2023-03-27 21:12:07 1146447 [3645]: s2:r4 leader 1918209 dblocks 57:140592393206058:0:0:0:0:1918209:0,59:140592393206060:0:0:0:0:1918209:0,60:140592393204061:0:0:0:0:1918209:0,70:140592393206071:140592393206071:97:1:1147629:1918209:0, >2023-03-27 21:12:07 1146447 [3645]: s2:r4 leader 1918209 owner 97 1 1147629 dblocks 89:140592393208090:0:0:0:0:1918210:0,96:140592393204097:140592393204097:97:1:1147629:1918209:1, >2023-03-27 21:12:07 1146447 [3645]: s2:r4 paxos_acquire leader 1918209 owner 97 1 1147629 max mbal[89] 140592393208090 our_dblock 140592393206071 140592393206071 97 1 1147629 1918209 >2023-03-27 21:12:07 1146447 [3645]: s2:r4 paxos_acquire owner 97 1 1147629 host_status 97 1 1147595 wait_start 1146434 >2023-03-27 21:12:08 1146448 [3645]: s2:r4 paxos_acquire owner 97 delta 97 1 1147595 alive >2023-03-27 21:12:08 1146448 [3645]: s2:r4 paxos_acquire owner 97 1 1147629 writer 71 owner dblock released >2023-03-27 21:12:08 1146448 [3645]: s2:r4 paxos_acquire leader 1918209 owner 97 1 1147629 >2023-03-27 21:12:08 1146448 [3645]: s2:r4 ballot 1918210 phase1 write mbal 140592393210071 >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 phase1 read 26:140592393208027:0:0:0:0:1918210:0,35:140592393208036:0:0:0:0:1918210:0,41:140592393210042:0:0:0:0:1918210:0,70:140592393210071:0:0:0:0:1918210:0, >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 mode[96] shared 1 gen 1 >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 phase1 read 89:140592393208090:140592393208090:90:1:1147170:1918210:0, >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 choose bk_max[89] lver 1918210 mbal 140592393208090 bal 140592393208090 inp 90 1 1147170 >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 phase2 write bal 140592393210071 inp 90 1 1147170 q_max 89 >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 phase2 read 26:140592393208027:0:0:0:0:1918210:0,35:140592393208036:0:0:0:0:1918210:0,41:140592393210042:140592393210042:90:1:1147170:1918210:0,70:140592393210071:140592393210071:90:1:1147170:1918210:0, >2023-03-27 21:12:09 1146449 [3645]: s2:r4 ballot 1918210 phase2 read 89:140592393208090:140592393208090:90:1:1147170:1918210:1, >2023-03-27 21:12:10 1146449 [3645]: s2:r4 ballot 1918210 commit other owner 90 1 1147170 >2023-03-27 21:12:10 1146449 [3645]: s2:r4 acquire_disk rv -245 lver 1918210 at 1147170 >2023-03-27 21:12:10 1146449 [3645]: s2:r4 acquire_token held error -245 >2023-03-27 21:12:10 1146449 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:10 1146449 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:10 1146449 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -245 lease owned by other host >2023-03-27 21:12:10 1146449 [3645]: cmd_acquire 3,10,12513 result -245 pid_dead 0 >2023-03-27 21:12:10 1146449 [30594]: s1:r2 ballot 1886509 abort1 larger mbal in bk[20] 4379892021:0:0:0:0:1886509 our dblock 4379890101:0:0:0:0:1886509 >2023-03-27 21:12:10 1146449 [30594]: s1:r2 ballot 1886509 phase1 read 12:4379890013:0:0:0:0:1886509:0,20:4379892021:0:0:0:0:1886509:0, >2023-03-27 21:12:10 1146449 [30594]: s1:r2 paxos_acquire 1886509 retry delay 469634 us >2023-03-27 21:12:11 1146450 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:11 1146450 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 leader 1918210 dblocks 26:140592393208027:0:0:0:0:1918210:0,35:140592393208036:0:0:0:0:1918210:0,60:140592393212061:0:0:0:0:1918211:0,70:140592393210071:140592393210071:90:1:1147170:1918210:0, >2023-03-27 21:12:11 1146451 [3645]: s2:r4 leader 1918210 owner 90 1 1147170 dblocks 89:140592393208090:140592393208090:90:1:1147170:1918210:1, >2023-03-27 21:12:11 1146451 [3645]: s2:r4 paxos_acquire leader 1918210 owner 90 1 1147170 max mbal[60] 140592393212061 our_dblock 140592393210071 140592393210071 90 1 1147170 1918210 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 paxos_acquire owner 90 1 1147170 host_status 90 1 1147132 wait_start 1146434 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 paxos_acquire owner 90 delta 90 1 1147173 alive >2023-03-27 21:12:11 1146451 [3645]: s2:r4 acquire_disk rv -243 lver 1918210 at 1147170 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:11 1146451 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:11 1146451 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:11 1146451 [30594]: s1:r2 paxos_acquire leader 1886508 owner 91 2 1146970 >2023-03-27 21:12:11 1146451 [30594]: s1:r2 ballot 1886509 phase1 write mbal 4379892101 >2023-03-27 21:12:12 1146452 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:12 1146452 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:13 1146452 [3645]: s2:r4 leader 1918211 dblocks 1:140592393212002:0:0:0:0:1918211:0,8:140592393214009:0:0:0:0:1918211:0,41:140592393214042:0:0:0:0:1918211:0,55:140592393212056:0:0:0:0:1918211:0, >2023-03-27 21:12:13 1146452 [3645]: s2:r4 leader 1918211 dblocks 57:140592393212058:0:0:0:0:1918211:0,59:140592393214060:0:0:0:0:1918211:0,60:140592393212061:140592393212061:61:1:1146648:1918211:0,63:140592393214064:0:0:0:0:1918211:0, >2023-03-27 21:12:13 1146452 [3645]: s2:r4 leader 1918211 owner 61 1 1146648 dblocks 89:140592393214090:140592393214090:61:1:1146648:1918211:0, >2023-03-27 21:12:13 1146452 [3645]: s2:r4 paxos_acquire leader 1918211 owner 61 1 1146648 max mbal[89] 140592393214090 our_dblock 140592393210071 140592393210071 90 1 1147170 1918210 >2023-03-27 21:12:13 1146452 [3645]: s2:r4 paxos_acquire owner 61 1 1146648 host_status 61 1 1146607 wait_start 1146434 >2023-03-27 21:12:13 1146453 [3645]: s2:r4 paxos_acquire owner 61 delta 61 1 1146648 alive >2023-03-27 21:12:13 1146453 [3645]: s2:r4 paxos_acquire owner 61 1 1146648 writer 90 owner dblock released >2023-03-27 21:12:13 1146453 [3645]: s2:r4 paxos_acquire leader 1918211 owner 61 1 1146648 >2023-03-27 21:12:13 1146453 [3645]: s2:r4 ballot 1918212 phase1 write mbal 140592393216071 >2023-03-27 21:12:14 1146454 [30594]: s1:r2 ballot 1886509 abort1 larger mbal in bk[20] 4379894021:0:0:0:0:1886509 our dblock 4379892101:0:0:0:0:1886509 >2023-03-27 21:12:14 1146454 [30594]: s1:r2 ballot 1886509 phase1 read 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0, >2023-03-27 21:12:14 1146454 [30594]: s1:r2 paxos_acquire 1886509 retry delay 399366 us >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 mode[96] shared 1 gen 1 >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 phase1 read 54:140592393216055:140592393216055:55:1:1146585:1918212:0,70:140592393216071:0:0:0:0:1918212:0, >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 choose bk_max[54] lver 1918212 mbal 140592393216055 bal 140592393216055 inp 55 1 1146585 >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 phase2 write bal 140592393216071 inp 55 1 1146585 q_max 54 >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 abort2 larger mbal in bk[89] 140592393218090:0:0:0:0:1918212 our dblock 140592393216071:140592393216071:55:1:1146585:1918212 >2023-03-27 21:12:14 1146454 [3645]: s2:r4 ballot 1918212 phase2 read 54:140592393216055:140592393216055:55:1:1146585:1918212:0,56:140592393216057:0:0:0:0:1918212:0,70:140592393216071:140592393216071:55:1:1146585:1918212:0,89:140592393218090:0:0:0:0:1918212:0, >2023-03-27 21:12:14 1146454 [3645]: s2:r4 paxos_acquire 1918212 retry delay 904270 us >2023-03-27 21:12:15 1146455 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 paxos_acquire 1886509 owner is 92 1 1146639 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 acquire_disk rv -244 lver 1886509 at 1146639 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 acquire_token held error -244 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -244 lease owned by other host >2023-03-27 21:12:15 1146455 [30594]: cmd_acquire 2,9,12513 result -244 pid_dead 0 >2023-03-27 21:12:15 1146455 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:12:15 1146455 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 paxos_acquire 1918212 owner is 55 1 1146585 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 acquire_disk rv -244 lver 1918212 at 1146585 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 acquire_token held error -244 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:15 1146455 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -244 lease owned by other host >2023-03-27 21:12:15 1146455 [3645]: cmd_acquire 3,10,12513 result -244 pid_dead 0 >2023-03-27 21:12:16 1146456 [12616]: s1 delta_renew begin read >2023-03-27 21:12:16 1146456 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:16 1146456 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:17 1146456 [3645]: s2:r4 leader 1918212 dblocks 1:140592393218002:0:0:0:0:1918212:0,26:140592393218027:0:0:0:0:1918212:0,28:140592393216029:0:0:0:0:1918212:0,54:140592393218055:0:0:0:0:1918212:0, >2023-03-27 21:12:17 1146456 [3645]: s2:r4 leader 1918212 dblocks 56:140592393216057:0:0:0:0:1918212:0,57:140592393218058:0:0:0:0:1918212:0,60:140592393218061:0:0:0:0:1918212:0,63:140592393218064:0:0:0:0:1918212:0, >2023-03-27 21:12:17 1146456 [3645]: s2:r4 leader 1918212 owner 55 1 1146585 dblocks 70:140592393216071:140592393216071:55:1:1146585:1918212:0,89:140592393218090:140592393218090:55:1:1146585:1918212:0,97:140592393218098:140592393218098:55:1:1146585:1918212:0, >2023-03-27 21:12:17 1146456 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 max mbal[97] 140592393218098 our_dblock 140592393216071 140592393216071 55 1 1146585 1918212 >2023-03-27 21:12:17 1146456 [3645]: s2:r4 paxos_acquire owner 55 1 1146585 host_status 55 1 1146525 wait_start 1146434 >2023-03-27 21:12:17 1146456 [30594]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0, >2023-03-27 21:12:17 1146456 [30594]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,44:4379894045:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0, >2023-03-27 21:12:17 1146456 [30594]: s1:r2 leader 1886509 dblocks 50:4379894051:4379894051:92:1:1146639:1886509:0,58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0, >2023-03-27 21:12:17 1146456 [30594]: s1:r2 leader 1886509 dblocks 80:4379892081:4379892081:92:1:1146639:1886509:0,82:4379892083:0:0:0:0:1886509:0,90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0, >2023-03-27 21:12:17 1146456 [30594]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 100:4379892101:0:0:0:0:1886509:0, >2023-03-27 21:12:17 1146456 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 4379892101 0 0 0 0 1886509 >2023-03-27 21:12:17 1146456 [30594]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146596 wait_start 1146415 >2023-03-27 21:12:17 1146457 [3645]: s2:r4 paxos_acquire owner 55 delta 55 1 1146566 alive >2023-03-27 21:12:17 1146457 [3645]: s2:r4 paxos_acquire owner 55 1 1146585 writer 90 owner dblock released >2023-03-27 21:12:17 1146457 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:17 1146457 [3645]: s2:r4 paxos_acquire 1918213 restart leader changed2 from 55 1 1146585 to 55 1 1146585 >2023-03-27 21:12:18 1146457 [3645]: s2:r4 leader 1918212 dblocks 1:140592393218002:0:0:0:0:1918212:0,26:140592393218027:0:0:0:0:1918212:0,28:140592393216029:0:0:0:0:1918212:0,54:140592393218055:0:0:0:0:1918212:1, >2023-03-27 21:12:18 1146457 [3645]: s2:r4 leader 1918212 dblocks 56:140592393216057:0:0:0:0:1918212:0,57:140592393218058:0:0:0:0:1918212:0,60:140592393218061:0:0:0:0:1918212:0,63:140592393218064:0:0:0:0:1918212:0, >2023-03-27 21:12:18 1146457 [3645]: s2:r4 leader 1918212 owner 55 1 1146585 dblocks 70:140592393216071:140592393216071:55:1:1146585:1918212:0,89:140592393218090:140592393218090:55:1:1146585:1918212:0,97:140592393218098:140592393218098:55:1:1146585:1918212:0, >2023-03-27 21:12:18 1146457 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 max mbal[97] 140592393218098 our_dblock 140592393216071 140592393216071 55 1 1146585 1918212 >2023-03-27 21:12:18 1146457 [3645]: s2:r4 paxos_acquire owner 55 1 1146585 host_status 55 1 1146525 wait_start 1146434 >2023-03-27 21:12:18 1146457 [12616]: s1 delta_renew begin write for new ts 1146457 >2023-03-27 21:12:18 1146458 [3645]: s2:r4 paxos_acquire owner 55 delta 55 1 1146566 alive >2023-03-27 21:12:18 1146458 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive >2023-03-27 21:12:18 1146458 [3645]: s2:r4 paxos_acquire owner 55 1 1146585 writer 98 owner dblock released >2023-03-27 21:12:18 1146458 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:18 1146458 [3645]: s2:r4 ballot 1918213 phase1 write mbal 140592393220071 >2023-03-27 21:12:19 1146458 [3645]: s2:r4 ballot 1918213 abort1 larger mbal in bk[54] 140592393222055:0:0:0:0:1918213 our dblock 140592393220071:0:0:0:0:1918213 >2023-03-27 21:12:19 1146458 [3645]: s2:r4 ballot 1918213 phase1 read 1:140592393220002:0:0:0:0:1918213:0,8:140592393220009:0:0:0:0:1918213:0,54:140592393222055:0:0:0:0:1918213:0, >2023-03-27 21:12:19 1146458 [3645]: s2:r4 paxos_acquire 1918213 retry delay 958649 us >2023-03-27 21:12:19 1146459 [12616]: s1 renewed 1146457 delta_length 3 interval 42 >2023-03-27 21:12:19 1146459 [30594]: s1:r2 acquire_disk rv -243 lver 1886509 at 1146639 >2023-03-27 21:12:19 1146459 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:12:19 1146459 [30594]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:12:20 1146460 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:20 1146460 [3645]: s2:r4 ballot 1918213 phase1 write mbal 140592393222071 >2023-03-27 21:12:20 1146460 [3645]: s2:r4 ballot 1918213 phase1 read 1:140592393222002:0:0:0:0:1918213:0,8:140592393222009:0:0:0:0:1918213:0,54:140592393222055:140592393222055:61:1:1146655:1918213:0,55:140592393220056:0:0:0:0:1918213:0, >2023-03-27 21:12:20 1146460 [3645]: s2:r4 ballot 1918213 abort1 larger mbal in bk[57] 140592393224058:0:0:0:0:1918213 our dblock 140592393222071:0:0:0:0:1918213 >2023-03-27 21:12:20 1146460 [3645]: s2:r4 ballot 1918213 phase1 read 56:140592393222057:0:0:0:0:1918213:0,57:140592393224058:0:0:0:0:1918213:0, >2023-03-27 21:12:20 1146460 [3645]: s2:r4 paxos_acquire 1918213 retry delay 738085 us >2023-03-27 21:12:21 1146461 [30594]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:12:21 1146461 [30594]: s1:r2 release_token done r_flags 1 >2023-03-27 21:12:21 1146461 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:21 1146461 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:12:21 1146461 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:12:21 1146461 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:21 1146461 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:21 1146461 [3645]: s2:r4 ballot 1918213 phase1 write mbal 140592393224071 >2023-03-27 21:12:22 1146461 [3645]: s2:r4 ballot 1918213 phase1 read 1:140592393224002:0:0:0:0:1918213:0,8:140592393224009:0:0:0:0:1918213:0,54:140592393224055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:22 1146461 [3645]: s2:r4 ballot 1918213 phase1 read 56:140592393224057:0:0:0:0:1918213:0,57:140592393224058:140592393224058:61:1:1146655:1918213:0,59:140592393224060:0:0:0:0:1918213:0,60:140592393224061:0:0:0:0:1918213:0, >2023-03-27 21:12:22 1146461 [3645]: s2:r4 ballot 1918213 abort1 larger mbal in bk[89] 140592393224090:0:0:0:0:1918213 our dblock 140592393224071:0:0:0:0:1918213 >2023-03-27 21:12:22 1146461 [3645]: s2:r4 ballot 1918213 phase1 read 63:140592393224064:140592393224064:61:1:1146655:1918213:0,70:140592393224071:0:0:0:0:1918213:0,89:140592393224090:0:0:0:0:1918213:0, >2023-03-27 21:12:22 1146461 [3645]: s2:r4 paxos_acquire 1918213 retry delay 334858 us >2023-03-27 21:12:22 1146462 [30594]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0, >2023-03-27 21:12:22 1146462 [30594]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,50:4379894051:4379894051:92:1:1146639:1886509:0, >2023-03-27 21:12:22 1146462 [30594]: s1:r2 leader 1886509 dblocks 58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,80:4379892081:4379892081:92:1:1146639:1886509:0, >2023-03-27 21:12:22 1146462 [30594]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 82:4379892083:0:0:0:0:1886509:0,90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0, >2023-03-27 21:12:22 1146462 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 0 0 0 0 0 0 >2023-03-27 21:12:22 1146462 [30594]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146638 wait_start 1146459 >2023-03-27 21:12:22 1146462 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:22 1146462 [3645]: s2:r4 ballot 1918213 phase1 write mbal 140592393226071 >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 phase1 read 1:140592393226002:0:0:0:0:1918213:0,8:140592393224009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 phase1 read 56:140592393224057:0:0:0:0:1918213:0,57:140592393226058:0:0:0:0:1918213:0,59:140592393226060:0:0:0:0:1918213:0,60:140592393224061:0:0:0:0:1918213:0, >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 mode[96] shared 1 gen 1 >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 phase1 read 63:140592393226064:0:0:0:0:1918213:0,70:140592393226071:0:0:0:0:1918213:0,89:140592393224090:140592393224090:61:1:1146655:1918213:0, >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 choose bk_max[89] lver 1918213 mbal 140592393224090 bal 140592393224090 inp 61 1 1146655 >2023-03-27 21:12:23 1146462 [3645]: s2:r4 ballot 1918213 phase2 write bal 140592393226071 inp 61 1 1146655 q_max 89 >2023-03-27 21:12:23 1146463 [3645]: s2:r4 ballot 1918213 phase2 read 1:140592393226002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:23 1146463 [3645]: s2:r4 ballot 1918213 abort2 larger mbal in bk[57] 140592393228058:0:0:0:0:1918213 our dblock 140592393226071:140592393226071:61:1:1146655:1918213 >2023-03-27 21:12:23 1146463 [3645]: s2:r4 ballot 1918213 phase2 read 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:0:0:0:0:1918213:0, >2023-03-27 21:12:23 1146463 [3645]: s2:r4 paxos_acquire 1918213 retry delay 11013 us >2023-03-27 21:12:23 1146463 [3645]: s2:r4 paxos_acquire leader 1918212 owner 55 1 1146585 >2023-03-27 21:12:23 1146463 [3645]: s2:r4 ballot 1918213 phase1 write mbal 140592393228071 >2023-03-27 21:12:23 1146463 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 phase1 read 1:140592393228002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 phase1 read 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393228060:0:0:0:0:1918213:0,60:140592393228061:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 mode[96] shared 2 gen 1 >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 phase1 read 63:140592393226064:0:0:0:0:1918213:0,70:140592393228071:0:0:0:0:1918213:0,89:140592393226090:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 choose bk_max[57] lver 1918213 mbal 140592393228058 bal 140592393228058 inp 61 1 1146655 >2023-03-27 21:12:24 1146463 [3645]: s2:r4 ballot 1918213 phase2 write bal 140592393228071 inp 61 1 1146655 q_max 57 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 ballot 1918213 phase2 read 1:140592393228002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146464 [3645]: s2:r4 ballot 1918213 phase2 read 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393228060:0:0:0:0:1918213:0,60:140592393228061:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146464 [3645]: s2:r4 ballot 1918213 phase2 read 63:140592393226064:0:0:0:0:1918213:0,70:140592393228071:140592393228071:61:1:1146655:1918213:0,89:140592393226090:0:0:0:0:1918213:0, >2023-03-27 21:12:24 1146464 [3645]: s2:r4 ballot 1918213 commit other owner 61 1 1146655 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 acquire_disk rv -245 lver 1918213 at 1146655 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 acquire_token held error -245 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:24 1146464 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -245 lease owned by other host >2023-03-27 21:12:24 1146464 [3645]: cmd_acquire 3,10,12513 result -245 pid_dead 0 >2023-03-27 21:12:25 1146464 [30594]: s1:r2 acquire_disk rv -243 lver 1886509 at 1146639 >2023-03-27 21:12:25 1146464 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:12:25 1146464 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:12:25 1146464 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:12:25 1146464 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:25 1146464 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:12:25 1146465 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:25 1146465 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:26 1146465 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:12:26 1146465 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:12:26 1146465 [3645]: s2:r4 leader 1918213 dblocks 1:140592393228002:0:0:0:0:1918213:0,8:140592393226009:0:0:0:0:1918213:0,54:140592393226055:0:0:0:0:1918213:0,55:140592393222056:0:0:0:0:1918213:0, >2023-03-27 21:12:26 1146465 [3645]: s2:r4 leader 1918213 dblocks 56:140592393226057:0:0:0:0:1918213:0,57:140592393228058:140592393228058:61:1:1146655:1918213:0,59:140592393228060:0:0:0:0:1918213:0,60:140592393228061:0:0:0:0:1918213:1, >2023-03-27 21:12:26 1146465 [3645]: s2:r4 leader 1918213 owner 61 1 1146655 dblocks 63:140592393230064:0:0:0:0:1918214:0,70:140592393228071:140592393228071:61:1:1146655:1918213:0,89:140592393226090:0:0:0:0:1918213:0, >2023-03-27 21:12:26 1146465 [3645]: s2:r4 paxos_acquire leader 1918213 owner 61 1 1146655 max mbal[63] 140592393230064 our_dblock 140592393228071 140592393228071 61 1 1146655 1918213 >2023-03-27 21:12:26 1146465 [3645]: s2:r4 paxos_acquire owner 61 1 1146655 host_status 61 1 1146607 wait_start 1146434 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 paxos_acquire owner 61 delta 61 1 1146648 alive >2023-03-27 21:12:26 1146466 [3645]: s2:r4 paxos_acquire owner 61 1 1146655 writer 71 owner dblock released >2023-03-27 21:12:26 1146466 [3645]: s2:r4 paxos_acquire leader 1918214 owner 64 1 1146859 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 paxos_acquire 1918214 owner is 64 1 1146859 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 acquire_disk rv -244 lver 1918214 at 1146859 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 acquire_token held error -244 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:26 1146466 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -244 lease owned by other host >2023-03-27 21:12:26 1146466 [3645]: cmd_acquire 3,10,12513 result -244 pid_dead 0 >2023-03-27 21:12:27 1146467 [30594]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0, >2023-03-27 21:12:27 1146467 [30594]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,50:4379894051:4379894051:92:1:1146639:1886509:0, >2023-03-27 21:12:27 1146467 [30594]: s1:r2 leader 1886509 dblocks 58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,82:4379892083:0:0:0:0:1886509:0, >2023-03-27 21:12:27 1146467 [30594]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:0, >2023-03-27 21:12:27 1146467 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 0 0 0 0 0 0 >2023-03-27 21:12:27 1146467 [30594]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146638 wait_start 1146459 >2023-03-27 21:12:27 1146467 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:27 1146467 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:28 1146467 [3645]: s2:r4 leader 1918214 dblocks 8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0, >2023-03-27 21:12:28 1146467 [3645]: s2:r4 leader 1918214 owner 64 1 1146859 dblocks 59:140592393230060:0:0:0:0:1918214:0,63:140592393230064:140592393230064:64:1:1146859:1918214:0,97:140592393230098:140592393230098:64:1:1146859:1918214:0, >2023-03-27 21:12:28 1146467 [3645]: s2:r4 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[97] 140592393230098 our_dblock 140592393228071 140592393228071 61 1 1146655 1918213 >2023-03-27 21:12:28 1146467 [3645]: s2:r4 paxos_acquire owner 64 1 1146859 host_status 64 1 1146794 wait_start 1146434 >2023-03-27 21:12:28 1146468 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:28 1146468 [3645]: s2:r4 acquire_disk rv -243 lver 1918214 at 1146859 >2023-03-27 21:12:28 1146468 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:28 1146468 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:28 1146468 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:28 1146468 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:28 1146468 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:28 1146468 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive >2023-03-27 21:12:29 1146469 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 leader 1918214 dblocks 8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0, >2023-03-27 21:12:29 1146469 [3645]: s2:r4 leader 1918214 owner 64 1 1146859 dblocks 59:140592393230060:0:0:0:0:1918214:0,63:140592393230064:140592393230064:64:1:1146859:1918214:0,97:140592393230098:140592393230098:64:1:1146859:1918214:0, >2023-03-27 21:12:29 1146469 [3645]: s2:r4 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[97] 140592393230098 our_dblock 140592393228071 140592393228071 61 1 1146655 1918213 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 paxos_acquire owner 64 1 1146859 host_status 64 1 1146794 wait_start 1146434 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:29 1146469 [3645]: s2:r4 acquire_disk rv -243 lver 1918214 at 1146859 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:29 1146469 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:29 1146469 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:30 1146470 [30594]: s1:r2 acquire_disk rv -243 lver 1886509 at 1146639 >2023-03-27 21:12:30 1146470 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:12:30 1146470 [30594]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:12:30 1146470 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:30 1146470 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:31 1146470 [3645]: s2:r4 leader 1918214 dblocks 8:140592393230009:0:0:0:0:1918214:0,26:140592393230027:0:0:0:0:1918214:0,35:140592393230036:0:0:0:0:1918214:0,54:140592393230055:0:0:0:0:1918214:0, >2023-03-27 21:12:31 1146470 [3645]: s2:r4 leader 1918214 owner 64 1 1146859 dblocks 59:140592393230060:0:0:0:0:1918214:0,63:140592393230064:140592393230064:64:1:1146859:1918214:1,97:140592393230098:140592393230098:64:1:1146859:1918214:0, >2023-03-27 21:12:31 1146470 [3645]: s2:r4 paxos_acquire leader 1918214 owner 64 1 1146859 max mbal[97] 140592393230098 our_dblock 140592393228071 140592393228071 61 1 1146655 1918213 >2023-03-27 21:12:31 1146470 [3645]: s2:r4 paxos_acquire owner 64 1 1146859 host_status 64 1 1146794 wait_start 1146434 >2023-03-27 21:12:31 1146471 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:31 1146471 [3645]: s2:r4 paxos_acquire owner 64 1 1146859 writer 98 owner dblock released >2023-03-27 21:12:31 1146471 [30594]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:12:31 1146471 [30594]: s1:r2 release_token done r_flags 1 >2023-03-27 21:12:31 1146471 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:31 1146471 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:12:31 1146471 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:12:31 1146471 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:31 1146471 [3645]: s2:r4 paxos_acquire leader 1918214 owner 64 1 1146859 >2023-03-27 21:12:31 1146471 [3645]: s2:r4 ballot 1918215 phase1 write mbal 140592393232071 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 ballot 1918215 phase1 read 8:140592393232009:0:0:0:0:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:0:0:0:0:1918215:0, >2023-03-27 21:12:32 1146472 [3645]: s2:r4 ballot 1918215 choose bk_max[63] lver 1918215 mbal 140592393232064 bal 140592393232064 inp 64 1 1146865 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 ballot 1918215 phase2 write bal 140592393232071 inp 64 1 1146865 q_max 63 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 ballot 1918215 phase2 read 8:140592393232009:0:0:0:0:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0, >2023-03-27 21:12:32 1146472 [3645]: s2:r4 ballot 1918215 commit other owner 64 1 1146865 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 acquire_disk rv -245 lver 1918215 at 1146865 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 acquire_token held error -245 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:32 1146472 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -245 lease owned by other host >2023-03-27 21:12:32 1146472 [3645]: cmd_acquire 3,10,12513 result -245 pid_dead 0 >2023-03-27 21:12:33 1146473 [30594]: s1:r2 leader 1886509 dblocks 12:4379892013:0:0:0:0:1886509:0,20:4379894021:0:0:0:0:1886509:0,27:4379892028:0:0:0:0:1886509:0,31:4379894032:0:0:0:0:1886509:0, >2023-03-27 21:12:33 1146473 [30594]: s1:r2 leader 1886509 dblocks 39:4379892040:0:0:0:0:1886509:0,45:4379892046:0:0:0:0:1886509:0,46:4379890047:0:0:0:0:1886509:0,50:4379894051:4379894051:92:1:1146639:1886509:0, >2023-03-27 21:12:33 1146473 [30594]: s1:r2 leader 1886509 dblocks 58:4379894059:4379894059:92:1:1146639:1886509:0,65:4379892066:0:0:0:0:1886509:0,71:4379890072:0:0:0:0:1886509:0,82:4379892083:0:0:0:0:1886509:0, >2023-03-27 21:12:33 1146473 [30594]: s1:r2 leader 1886509 owner 92 1 1146639 dblocks 90:4379892091:0:0:0:0:1886509:0,91:4379892092:0:0:0:0:1886509:1, >2023-03-27 21:12:33 1146473 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 max mbal[58] 4379894059 our_dblock 0 0 0 0 0 0 >2023-03-27 21:12:33 1146473 [30594]: s1:r2 paxos_acquire owner 92 1 1146639 host_status 92 1 1146638 wait_start 1146459 >2023-03-27 21:12:33 1146473 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:33 1146473 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:34 1146473 [3645]: s2:r4 leader 1918215 owner 64 1 1146865 dblocks 8:140592393234009:140592393234009:64:1:1146865:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0, >2023-03-27 21:12:34 1146473 [3645]: s2:r4 paxos_acquire leader 1918215 owner 64 1 1146865 max mbal[8] 140592393234009 our_dblock 140592393232071 140592393232071 64 1 1146865 1918215 >2023-03-27 21:12:34 1146473 [3645]: s2:r4 paxos_acquire owner 64 1 1146865 host_status 64 1 1146794 wait_start 1146434 >2023-03-27 21:12:34 1146474 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:34 1146474 [3645]: s2:r4 acquire_disk rv -243 lver 1918215 at 1146865 >2023-03-27 21:12:34 1146474 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:34 1146474 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:34 1146474 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:34 1146474 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:34 1146474 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:34 1146474 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146638 alive >2023-03-27 21:12:35 1146474 [17240]: s2 delta_renew begin read >2023-03-27 21:12:35 1146475 [17240]: s2 delta_renew begin write for new ts 1146475 >2023-03-27 21:12:35 1146475 [17240]: s2 renewed 1146475 delta_length 1 interval 41 >2023-03-27 21:12:35 1146475 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:35 1146475 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:35 1146475 [3645]: s2:r4 leader 1918215 owner 64 1 1146865 dblocks 8:140592393234009:140592393234009:64:1:1146865:1918215:0,59:140592393232060:0:0:0:0:1918215:0,63:140592393232064:140592393232064:64:1:1146865:1918215:0,70:140592393232071:140592393232071:64:1:1146865:1918215:0, >2023-03-27 21:12:35 1146475 [3645]: s2:r4 paxos_acquire leader 1918215 owner 64 1 1146865 max mbal[8] 140592393234009 our_dblock 140592393232071 140592393232071 64 1 1146865 1918215 >2023-03-27 21:12:35 1146475 [3645]: s2:r4 paxos_acquire owner 64 1 1146865 host_status 64 1 1146794 wait_start 1146434 >2023-03-27 21:12:36 1146475 [30594]: s1:r2 paxos_acquire owner 92 1 1146639 writer 59 owner dblock released >2023-03-27 21:12:36 1146475 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:36 1146476 [3645]: s2:r4 paxos_acquire owner 64 1 1146865 writer 9 owner dblock released >2023-03-27 21:12:36 1146476 [3645]: s2:r4 paxos_acquire leader 1918215 owner 64 1 1146865 >2023-03-27 21:12:36 1146476 [3645]: s2:r4 ballot 1918216 phase1 write mbal 140592393236071 >2023-03-27 21:12:37 1146476 [3645]: s2:r4 ballot 1918216 phase1 read 1:140592393236002:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:0:0:0:0:1918216:0, >2023-03-27 21:12:37 1146476 [3645]: s2:r4 ballot 1918216 choose bk_max[63] lver 1918216 mbal 140592393236064 bal 140592393236064 inp 64 1 1146870 >2023-03-27 21:12:37 1146476 [3645]: s2:r4 ballot 1918216 phase2 write bal 140592393236071 inp 64 1 1146870 q_max 63 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 ballot 1918216 phase2 read 1:140592393236002:0:0:0:0:1918216:0,35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0, >2023-03-27 21:12:37 1146477 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 >2023-03-27 21:12:37 1146477 [30594]: s1:r2 ballot 1886510 phase1 write mbal 4379896101 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 ballot 1918216 commit other owner 64 1 1146870 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 acquire_disk rv -245 lver 1918216 at 1146870 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 acquire_token held error -245 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:37 1146477 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -245 lease owned by other host >2023-03-27 21:12:37 1146477 [3645]: cmd_acquire 3,10,12513 result -245 pid_dead 0 >2023-03-27 21:12:38 1146478 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:38 1146478 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:39 1146478 [3645]: s2:r4 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0, >2023-03-27 21:12:39 1146478 [3645]: s2:r4 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:39 1146478 [3645]: s2:r4 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:39 1146479 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:39 1146479 [3645]: s2:r4 acquire_disk rv -243 lver 1918216 at 1146870 >2023-03-27 21:12:39 1146479 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:39 1146479 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:39 1146479 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:39 1146479 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:39 1146479 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:40 1146480 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:40 1146480 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:40 1146480 [3645]: s2:r4 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0, >2023-03-27 21:12:40 1146480 [3645]: s2:r4 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:40 1146480 [3645]: s2:r4 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:40 1146480 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:41 1146480 [30594]: s1:r2 ballot 1886510 abort1 larger mbal in bk[20] 4379898021:0:0:0:0:1886510 our dblock 4379896101:0:0:0:0:1886510 >2023-03-27 21:12:41 1146480 [30594]: s1:r2 ballot 1886510 phase1 read 12:4379896013:0:0:0:0:1886510:0,20:4379898021:0:0:0:0:1886510:0, >2023-03-27 21:12:41 1146480 [30594]: s1:r2 paxos_acquire 1886510 retry delay 207718 us >2023-03-27 21:12:41 1146480 [3645]: s2:r4 acquire_disk rv -243 lver 1918216 at 1146870 >2023-03-27 21:12:41 1146480 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:41 1146480 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:41 1146480 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:41 1146480 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:41 1146480 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:42 1146481 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:42 1146481 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 leader 1918216 owner 64 1 1146870 dblocks 35:140592393236036:0:0:0:0:1918216:0,63:140592393236064:140592393236064:64:1:1146870:1918216:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0, >2023-03-27 21:12:42 1146482 [3645]: s2:r4 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[70] 140592393236071 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146835 alive >2023-03-27 21:12:42 1146482 [30594]: s1:r2 paxos_acquire leader 1886509 owner 92 1 1146639 >2023-03-27 21:12:42 1146482 [30594]: s1:r2 ballot 1886510 phase1 write mbal 4379898101 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 acquire_disk rv -243 lver 1918216 at 1146870 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:42 1146482 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:42 1146482 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:43 1146483 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:43 1146483 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 leader 1918216 dblocks 1:140592393238002:0:0:0:0:1918217:0,28:140592393238029:0:0:0:0:1918217:0,35:140592393236036:0:0:0:0:1918216:0,41:140592393238042:0:0:0:0:1918217:0, >2023-03-27 21:12:44 1146484 [3645]: s2:r4 leader 1918216 owner 64 1 1146870 dblocks 55:140592393238056:0:0:0:0:1918217:0,57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:0:0:0:0:1918217:0,70:140592393236071:140592393236071:64:1:1146870:1918216:0, >2023-03-27 21:12:44 1146484 [3645]: s2:r4 paxos_acquire leader 1918216 owner 64 1 1146870 max mbal[63] 140592393238064 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 paxos_acquire owner 64 1 1146870 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:44 1146484 [3645]: s2:r4 acquire_disk rv -243 lver 1918216 at 1146870 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:44 1146484 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:44 1146484 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:45 1146485 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:45 1146485 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:46 1146485 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:46 1146485 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:46 1146485 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:46 1146485 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:46 1146486 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:46 1146486 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:46 1146486 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:46 1146486 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:46 1146486 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:46 1146486 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:46 1146486 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:46 1146486 [30594]: s1:r2 ballot 1886510 phase1 read 12:4379896013:0:0:0:0:1886510:0,20:4379898021:0:0:0:0:1886510:0,39:4379896040:0:0:0:0:1886510:0,44:4379898045:0:0:0:0:1886510:0, >2023-03-27 21:12:46 1146486 [30594]: s1:r2 ballot 1886510 phase1 read 45:4379898046:0:0:0:0:1886510:0,46:4379896047:0:0:0:0:1886510:0,50:4379896051:0:0:0:0:1886510:0,65:4379898066:0:0:0:0:1886510:0, >2023-03-27 21:12:46 1146486 [30594]: s1:r2 ballot 1886510 phase1 read 71:4379896072:0:0:0:0:1886510:0,80:4379898081:0:0:0:0:1886510:0,82:4379898083:0:0:0:0:1886510:0,100:4379898101:0:0:0:0:1886510:0, >2023-03-27 21:12:46 1146486 [30594]: s1:r2 ballot 1886510 phase2 write bal 4379898101 inp 101 1 1146486 q_max -1 >2023-03-27 21:12:47 1146487 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:47 1146487 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:47 1146487 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:47 1146487 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:47 1146487 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:47 1146487 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:48 1146487 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:48 1146488 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:48 1146488 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:48 1146488 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:48 1146488 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:48 1146488 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:48 1146488 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:49 1146489 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:49 1146489 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:49 1146489 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:49 1146489 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:49 1146489 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:49 1146489 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:49 1146489 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:50 1146489 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:50 1146489 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:50 1146489 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:50 1146489 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:50 1146489 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:50 1146489 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:50 1146490 [30594]: s1:r2 ballot 1886510 phase2 read 12:4379896013:0:0:0:0:1886510:0,20:4379898021:0:0:0:0:1886510:0,39:4379896040:0:0:0:0:1886510:0,44:4379898045:0:0:0:0:1886510:0, >2023-03-27 21:12:50 1146490 [30594]: s1:r2 ballot 1886510 phase2 read 45:4379898046:0:0:0:0:1886510:0,46:4379896047:0:0:0:0:1886510:0,50:4379896051:0:0:0:0:1886510:0,65:4379898066:0:0:0:0:1886510:0, >2023-03-27 21:12:50 1146490 [30594]: s1:r2 ballot 1886510 phase2 read 71:4379896072:0:0:0:0:1886510:0,80:4379898081:0:0:0:0:1886510:0,82:4379898083:0:0:0:0:1886510:0,100:4379898101:4379898101:101:1:1146486:1886510:0, >2023-03-27 21:12:51 1146490 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:51 1146490 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:51 1146491 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:51 1146491 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:51 1146491 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:51 1146491 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:51 1146491 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:52 1146491 [30594]: s1:r2 ballot 1886510 commit self owner 101 1 1146486 >2023-03-27 21:12:52 1146491 [30594]: s1:r2 acquire_disk rv 1 lver 1886510 at 1146486 >2023-03-27 21:12:52 1146492 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:52 1146492 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:53 1146492 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:53 1146492 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:53 1146492 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:53 1146492 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:53 1146493 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:53 1146493 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:53 1146493 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:53 1146493 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:53 1146493 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:53 1146493 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:53 1146493 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:53 1146493 [30594]: cmd_acquire 2,9,12513 result 0 pid_dead 0 >2023-03-27 21:12:53 1146493 [3645]: cmd_get_lvb ci 4 fd 12 result 0 res lvm_98e69d79725f49e2bcafdcd2f1a5ff9c:VGLK >2023-03-27 21:12:54 1146494 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:54 1146494 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:54 1146494 [30594]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:54 1146494 [30594]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:54 1146494 [30594]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:54 1146494 [30594]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:55 1146494 [30594]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:55 1146495 [30594]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:55 1146495 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:55 1146495 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:55 1146495 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:55 1146495 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:55 1146495 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:56 1146496 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:56 1146496 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:56 1146496 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:56 1146496 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:56 1146496 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:56 1146496 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:56 1146496 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:12:57 1146497 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:12:57 1146497 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:12:57 1146497 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:12:57 1146497 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:12:57 1146497 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:12:57 1146497 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:12:57 1146497 [12616]: s1 delta_renew begin read >2023-03-27 21:12:58 1146498 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:12:58 1146498 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:12:59 1146498 [30594]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:12:59 1146498 [30594]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:12:59 1146498 [30594]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:12:59 1146498 [30594]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:12:59 1146499 [12616]: s1 delta_renew begin write for new ts 1146499 >2023-03-27 21:12:59 1146499 [30594]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:00 1146500 [30594]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:13:00 1146500 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:00 1146500 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:00 1146500 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:00 1146500 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:00 1146500 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:00 1146500 [12616]: s1 renewed 1146499 delta_length 3 interval 42 >2023-03-27 21:13:01 1146501 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:01 1146501 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:02 1146502 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:13:02 1146502 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:13:02 1146502 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:02 1146502 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:13:04 1146503 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:05 1146505 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:13:05 1146505 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:05 1146505 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:05 1146505 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:05 1146505 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:05 1146505 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:06 1146506 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:06 1146506 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:08 1146508 [30594]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:13:08 1146508 [30594]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:13:08 1146508 [30594]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:08 1146508 [30594]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:13:10 1146510 [30594]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:12 1146512 [30594]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:13:12 1146512 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:12 1146512 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:12 1146512 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:12 1146512 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:12 1146512 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:13 1146513 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:13 1146513 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:15 1146515 [3645]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:13:15 1146515 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:13:15 1146515 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:15 1146515 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146835 wait_start 1146475 >2023-03-27 21:13:16 1146515 [17240]: s2 delta_renew begin read >2023-03-27 21:13:17 1146517 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:18 1146517 [17240]: s2 delta_renew begin write for new ts 1146517 >2023-03-27 21:13:19 1146518 [3645]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:13:19 1146518 [3645]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:19 1146518 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:19 1146518 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:19 1146518 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:19 1146518 [3645]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:19 1146519 [17240]: s2 renewed 1146517 delta_length 4 interval 42 >2023-03-27 21:13:20 1146519 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:20 1146519 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:21 1146521 [30594]: s2:r4 leader 1918217 dblocks 28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0,55:140592393240056:140592393240056:64:1:1146877:1918217:0, >2023-03-27 21:13:21 1146521 [30594]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 57:140592393238058:0:0:0:0:1918217:0,63:140592393238064:140592393238064:64:1:1146877:1918217:0, >2023-03-27 21:13:21 1146521 [30594]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[55] 140592393240056 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:21 1146521 [30594]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146520 >2023-03-27 21:13:22 1146521 [30594]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:22 1146522 [30594]: s2:r4 acquire_disk rv -243 lver 1918217 at 1146877 >2023-03-27 21:13:22 1146522 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:22 1146522 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:22 1146522 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:22 1146522 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:22 1146522 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:23 1146523 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:23 1146523 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:23 1146523 [3645]: s2:r4 leader 1918217 dblocks 8:140592393242009:0:0:0:0:1918218:0,28:140592393238029:0:0:0:0:1918217:0,35:140592393238036:0:0:0:0:1918217:0,41:140592393238042:0:0:0:0:1918217:0, >2023-03-27 21:13:23 1146523 [3645]: s2:r4 leader 1918217 owner 64 1 1146877 dblocks 55:140592393240056:140592393240056:64:1:1146877:1918217:0,57:140592393242058:0:0:0:0:1918218:0,63:140592393238064:140592393238064:64:1:1146877:1918217:1, >2023-03-27 21:13:23 1146523 [3645]: s2:r4 paxos_acquire leader 1918217 owner 64 1 1146877 max mbal[57] 140592393242058 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:23 1146523 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 host_status 64 1 1146876 wait_start 1146520 >2023-03-27 21:13:24 1146523 [3645]: s2:r4 paxos_acquire owner 64 delta 64 1 1146876 alive >2023-03-27 21:13:24 1146524 [3645]: s2:r4 paxos_acquire owner 64 1 1146877 writer 56 owner dblock released >2023-03-27 21:13:24 1146524 [3645]: s2:r4 paxos_acquire leader 1918218 owner 58 1 1146589 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 paxos_acquire 1918218 owner is 58 1 1146589 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 acquire_disk rv -244 lver 1918218 at 1146589 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 acquire_token held error -244 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:24 1146524 [3645]: s2:r4 cmd_acquire 3,10,12513 acquire_token -244 lease owned by other host >2023-03-27 21:13:24 1146524 [3645]: cmd_acquire 3,10,12513 result -244 pid_dead 0 >2023-03-27 21:13:25 1146525 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:25 1146525 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:25 1146525 [30594]: s2:r4 leader 1918218 owner 58 1 1146589 dblocks 57:140592393242058:140592393242058:58:1:1146589:1918218:0,59:140592393242060:0:0:0:0:1918218:0,60:140592393242061:140592393242061:58:1:1146589:1918218:0, >2023-03-27 21:13:25 1146525 [30594]: s2:r4 paxos_acquire leader 1918218 owner 58 1 1146589 max mbal[60] 140592393242061 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:25 1146525 [30594]: s2:r4 paxos_acquire owner 58 1 1146589 host_status 58 1 1146550 wait_start 1146520 >2023-03-27 21:13:25 1146525 [30594]: s2:r4 paxos_acquire owner 58 delta 58 1 1146591 alive >2023-03-27 21:13:26 1146525 [30594]: s2:r4 acquire_disk rv -243 lver 1918218 at 1146589 >2023-03-27 21:13:26 1146525 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:13:26 1146525 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:13:26 1146525 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:13:26 1146525 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:13:26 1146525 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:13:27 1146526 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:13:27 1146526 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:13:27 1146527 [3645]: s2:r4 leader 1918218 owner 58 1 1146589 dblocks 57:140592393242058:140592393242058:58:1:1146589:1918218:0,59:140592393242060:0:0:0:0:1918218:0,60:140592393242061:140592393242061:58:1:1146589:1918218:0, >2023-03-27 21:13:27 1146527 [3645]: s2:r4 paxos_acquire leader 1918218 owner 58 1 1146589 max mbal[60] 140592393242061 our_dblock 140592393236071 140592393236071 64 1 1146870 1918216 >2023-03-27 21:13:27 1146527 [3645]: s2:r4 paxos_acquire owner 58 1 1146589 host_status 58 1 1146550 wait_start 1146520 >2023-03-27 21:13:27 1146527 [3645]: s2:r4 paxos_acquire owner 58 delta 58 1 1146591 alive >2023-03-27 21:13:27 1146527 [3645]: s2:r4 paxos_acquire owner 58 1 1146589 writer 61 owner dblock released >2023-03-27 21:13:27 1146527 [3645]: s2:r4 paxos_acquire leader 1918218 owner 58 1 1146589 >2023-03-27 21:13:27 1146527 [3645]: s2:r4 ballot 1918219 phase1 write mbal 140592393244071 >2023-03-27 21:13:28 1146528 [3645]: s2:r4 ballot 1918219 phase1 read 1:140592393244002:0:0:0:0:1918219:0,70:140592393244071:0:0:0:0:1918219:0, >2023-03-27 21:13:28 1146528 [3645]: s2:r4 ballot 1918219 phase2 write bal 140592393244071 inp 71 1 1146528 q_max -1 >2023-03-27 21:13:28 1146528 [3645]: s2:r4 ballot 1918219 abort2 larger mbal in bk[57] 140592393246058:0:0:0:0:1918219 our dblock 140592393244071:140592393244071:71:1:1146528:1918219 >2023-03-27 21:13:28 1146528 [3645]: s2:r4 ballot 1918219 phase2 read 1:140592393244002:0:0:0:0:1918219:0,8:140592393244009:0:0:0:0:1918219:0,57:140592393246058:0:0:0:0:1918219:0, >2023-03-27 21:13:28 1146528 [3645]: s2:r4 paxos_acquire 1918219 retry delay 734225 us >2023-03-27 21:13:29 1146529 [3645]: s2:r4 paxos_acquire leader 1918218 owner 58 1 1146589 >2023-03-27 21:13:29 1146529 [3645]: s2:r4 ballot 1918219 phase1 write mbal 140592393246071 >2023-03-27 21:13:30 1146529 [3645]: s2:r4 ballot 1918219 phase1 read 1:140592393246002:0:0:0:0:1918219:0,8:140592393246009:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0, >2023-03-27 21:13:30 1146529 [3645]: s2:r4 ballot 1918219 abort1 larger mbal in bk[89] 140592393246090:140592393246090:71:1:1146528:1918219 our dblock 140592393246071:0:0:0:0:1918219 >2023-03-27 21:13:30 1146529 [3645]: s2:r4 ballot 1918219 phase1 read 60:140592393246061:0:0:0:0:1918219:0,70:140592393246071:0:0:0:0:1918219:0,89:140592393246090:140592393246090:71:1:1146528:1918219:0, >2023-03-27 21:13:30 1146529 [3645]: s2:r4 paxos_acquire 1918219 retry delay 915283 us >2023-03-27 21:13:31 1146531 [3645]: s2:r4 paxos_acquire leader 1918219 owner 71 1 1146528 >2023-03-27 21:13:31 1146531 [3645]: s2:r4 paxos_acquire 1918219 owner is our inp 71 1 1146528 committed by 90 >2023-03-27 21:13:31 1146531 [3645]: s2:r4 acquire_disk rv 1 lver 1918219 at 1146528 >2023-03-27 21:13:31 1146531 [3645]: cmd_acquire 3,10,12513 result 0 pid_dead 0 >2023-03-27 21:13:31 1146531 [30594]: cmd_get_lvb ci 4 fd 12 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK >2023-03-27 21:13:40 1146540 [12616]: s1 delta_renew begin read >2023-03-27 21:13:42 1146541 [12616]: s1 delta_renew begin write for new ts 1146541 >2023-03-27 21:13:43 1146543 [12616]: s1 renewed 1146541 delta_length 3 interval 42 >2023-03-27 21:13:57 1146557 [3645]: cmd_set_lvb ci 4 fd 12 result 0 res lvm_98e69d79725f49e2bcafdcd2f1a5ff9c:VGLK >2023-03-27 21:13:57 1146557 [30594]: cmd_release 2,9,12513 ci_in 2 fd 9 count 1 flags 0 >2023-03-27 21:13:57 1146557 [30594]: s1:r2 release_token r_flags 28 lver 1886510 >2023-03-27 21:13:57 1146557 [30594]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 4379898101:4379898101:101:1:1146486:1886510:RELEASED. >2023-03-27 21:13:57 1146557 [17240]: s2 delta_renew begin read >2023-03-27 21:13:58 1146557 [30594]: s1:r2 paxos_release leader 1886510 owner 101 1 1146486 >2023-03-27 21:13:58 1146558 [30594]: s1:r2 release_token done r_flags 28 >2023-03-27 21:13:58 1146558 [30594]: cmd_release 2,9,12513 result 0 pid_dead 0 count 1 >2023-03-27 21:13:58 1146558 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:13:58 1146558 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:13:58 1146558 [3645]: s1:r2 leader 1886510 dblocks 12:4379896013:0:0:0:0:1886510:0,20:4379898021:0:0:0:0:1886510:0,39:4379896040:0:0:0:0:1886510:0,46:4379896047:0:0:0:0:1886510:0, >2023-03-27 21:13:58 1146558 [3645]: s1:r2 leader 1886510 dblocks 50:4379896051:0:0:0:0:1886510:0,65:4379898066:0:0:0:0:1886510:0,71:4379896072:0:0:0:0:1886510:0,82:4379898083:0:0:0:0:1886510:0, >2023-03-27 21:13:58 1146558 [3645]: s1:r2 leader 1886510 owner 101 1 0 dblocks 100:4379898101:4379898101:101:1:1146486:1886510:1, >2023-03-27 21:13:58 1146558 [3645]: s1:r2 paxos_acquire leader 1886510 owner 101 1 0 max mbal[100] 4379898101 our_dblock 4379898101 4379898101 101 1 1146486 1886510 >2023-03-27 21:13:58 1146558 [3645]: s1:r2 paxos_acquire leader 1886510 free >2023-03-27 21:13:58 1146558 [3645]: s1:r2 ballot 1886511 phase1 write mbal 4379900101 >2023-03-27 21:13:58 1146558 [3645]: s1:r2 ballot 1886511 abort1 larger mbal in bk[45] 4379902046:0:0:0:0:1886511 our dblock 4379900101:0:0:0:0:1886511 >2023-03-27 21:13:58 1146558 [3645]: s1:r2 ballot 1886511 phase1 read 20:4379900021:0:0:0:0:1886511:0,45:4379902046:0:0:0:0:1886511:0, >2023-03-27 21:13:58 1146558 [3645]: s1:r2 paxos_acquire 1886511 retry delay 166366 us >2023-03-27 21:13:59 1146559 [3645]: s1:r2 paxos_acquire leader 1886510 owner 101 1 0 >2023-03-27 21:13:59 1146559 [3645]: s1:r2 ballot 1886511 phase1 write mbal 4379902101 >2023-03-27 21:13:59 1146559 [3645]: s1:r2 ballot 1886511 abort1 larger mbal in bk[27] 4379904028:0:0:0:0:1886511 our dblock 4379902101:0:0:0:0:1886511 >2023-03-27 21:13:59 1146559 [3645]: s1:r2 ballot 1886511 phase1 read 20:4379900021:0:0:0:0:1886511:0,27:4379904028:0:0:0:0:1886511:0, >2023-03-27 21:13:59 1146559 [3645]: s1:r2 paxos_acquire 1886511 retry delay 472309 us >2023-03-27 21:14:00 1146560 [3645]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 paxos_acquire 1886511 owner is 92 1 1146756 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 acquire_disk rv -244 lver 1886511 at 1146756 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 acquire_token held error -244 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:14:00 1146560 [17240]: s2 delta_renew begin write for new ts 1146560 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:14:00 1146560 [3645]: s1:r2 release_token done r_flags 1 >2023-03-27 21:14:00 1146560 [3645]: s1:r2 cmd_acquire 2,9,12513 acquire_token -244 lease owned by other host >2023-03-27 21:14:00 1146560 [3645]: cmd_acquire 2,9,12513 result -244 pid_dead 0 >2023-03-27 21:14:00 1146560 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:00 1146560 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:00 1146560 [30594]: s1:r2 leader 1886511 dblocks 20:4379900021:0:0:0:0:1886511:0,27:4379904028:0:0:0:0:1886511:0,44:4379906045:4379906045:92:1:1146756:1886511:0,45:4379904046:0:0:0:0:1886511:0, >2023-03-27 21:14:00 1146560 [30594]: s1:r2 leader 1886511 owner 92 1 1146756 dblocks 71:4379902072:0:0:0:0:1886511:0,80:4379902081:0:0:0:0:1886511:0,82:4379904083:0:0:0:0:1886511:0,91:4379904092:4379904092:92:1:1146756:1886511:0, >2023-03-27 21:14:00 1146560 [30594]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 max mbal[44] 4379906045 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:00 1146560 [30594]: s1:r2 paxos_acquire owner 92 1 1146756 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:01 1146560 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive >2023-03-27 21:14:01 1146560 [30594]: s1:r2 acquire_disk rv -243 lver 1886511 at 1146756 >2023-03-27 21:14:01 1146560 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:01 1146560 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:01 1146560 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:01 1146560 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:01 1146560 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:02 1146561 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:02 1146561 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:14:02 1146562 [3645]: s1:r2 leader 1886511 dblocks 12:4379902013:0:0:0:0:1886511:0,20:4379900021:0:0:0:0:1886511:0,27:4379904028:0:0:0:0:1886511:0,44:4379906045:4379906045:92:1:1146756:1886511:0, >2023-03-27 21:14:02 1146562 [3645]: s1:r2 leader 1886511 dblocks 45:4379904046:0:0:0:0:1886511:0,71:4379902072:0:0:0:0:1886511:0,80:4379902081:0:0:0:0:1886511:0,82:4379904083:0:0:0:0:1886511:0, >2023-03-27 21:14:02 1146562 [3645]: s1:r2 leader 1886511 owner 92 1 1146756 dblocks 91:4379904092:4379904092:92:1:1146756:1886511:0, >2023-03-27 21:14:02 1146562 [3645]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 max mbal[44] 4379906045 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:02 1146562 [3645]: s1:r2 paxos_acquire owner 92 1 1146756 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:02 1146562 [17240]: s2 renewed 1146560 delta_length 5 interval 43 >2023-03-27 21:14:02 1146562 [3645]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive >2023-03-27 21:14:03 1146562 [3645]: s1:r2 paxos_acquire owner 92 1 1146756 writer 45 owner dblock released >2023-03-27 21:14:03 1146563 [3645]: s1:r2 paxos_acquire leader 1886511 owner 92 1 1146756 >2023-03-27 21:14:03 1146563 [3645]: s1:r2 ballot 1886512 phase1 write mbal 4379908101 >2023-03-27 21:14:03 1146563 [3645]: s1:r2 ballot 1886512 phase1 read 91:4379908092:4379908092:92:1:1146760:1886512:0,100:4379908101:0:0:0:0:1886512:0, >2023-03-27 21:14:03 1146563 [3645]: s1:r2 ballot 1886512 choose bk_max[91] lver 1886512 mbal 4379908092 bal 4379908092 inp 92 1 1146760 >2023-03-27 21:14:03 1146563 [3645]: s1:r2 ballot 1886512 phase2 write bal 4379908101 inp 92 1 1146760 q_max 91 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 ballot 1886512 phase2 read 91:4379908092:4379908092:92:1:1146760:1886512:0,100:4379908101:4379908101:92:1:1146760:1886512:0, >2023-03-27 21:14:04 1146564 [3645]: s1:r2 ballot 1886512 commit other owner 92 1 1146760 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 acquire_disk rv -245 lver 1886512 at 1146760 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 acquire_token held error -245 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:14:04 1146564 [3645]: s1:r2 release_token done r_flags 1 >2023-03-27 21:14:04 1146564 [3645]: s1:r2 cmd_acquire 2,9,12513 acquire_token -245 lease owned by other host >2023-03-27 21:14:04 1146564 [3645]: cmd_acquire 2,9,12513 result -245 pid_dead 0 >2023-03-27 21:14:04 1146564 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:04 1146564 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:04 1146564 [30594]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:04 1146564 [30594]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:04 1146564 [30594]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:05 1146565 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146721 alive >2023-03-27 21:14:05 1146565 [30594]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:05 1146565 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:05 1146565 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:05 1146565 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:05 1146565 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:05 1146565 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:06 1146566 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:06 1146566 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:14:06 1146566 [3645]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:06 1146566 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:06 1146566 [3645]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:07 1146566 [3645]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:07 1146567 [3645]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:07 1146567 [3645]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:07 1146567 [3645]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:14:08 1146567 [3645]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:14:08 1146567 [3645]: s1:r2 release_token done r_flags 1 >2023-03-27 21:14:08 1146567 [3645]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:08 1146567 [3645]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:08 1146567 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:08 1146567 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:08 1146568 [30594]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:08 1146568 [30594]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:08 1146568 [30594]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:09 1146568 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:09 1146569 [30594]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:09 1146569 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:09 1146569 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:09 1146569 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:09 1146569 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:09 1146569 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:10 1146570 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:10 1146570 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xe 512 1048576 >2023-03-27 21:14:11 1146570 [3645]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:11 1146570 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:11 1146570 [3645]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:11 1146571 [3645]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:12 1146572 [3645]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:12 1146572 [3645]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:12 1146572 [3645]: s1:r2 release_token r_flags 1 lver 0 >2023-03-27 21:14:13 1146573 [3645]: s1:r2 write_host_block host_id 101 flags 0 gen 0 dblock 0:0:0:0:0:0:RELEASED. >2023-03-27 21:14:13 1146573 [3645]: s1:r2 release_token done r_flags 1 >2023-03-27 21:14:13 1146573 [3645]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:13 1146573 [3645]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:13 1146573 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:13 1146573 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:14 1146574 [30594]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:14 1146574 [30594]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:14 1146574 [30594]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:15 1146575 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:16 1146576 [30594]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:16 1146576 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:16 1146576 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:16 1146576 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:16 1146576 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:16 1146576 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:17 1146577 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:17 1146577 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:19 1146578 [3645]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:19 1146578 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:19 1146578 [3645]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:20 1146580 [3645]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:21 1146581 [12616]: s1 delta_renew begin read >2023-03-27 21:14:21 1146581 [3645]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:21 1146581 [3645]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:21 1146581 [3645]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:21 1146581 [3645]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:21 1146581 [3645]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:21 1146581 [3645]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:22 1146582 [30594]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:22 1146582 [30594]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:23 1146583 [12616]: s1 delta_renew begin write for new ts 1146583 >2023-03-27 21:14:25 1146584 [30594]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:0, >2023-03-27 21:14:25 1146584 [30594]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:25 1146584 [30594]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146721 wait_start 1146544 >2023-03-27 21:14:25 1146585 [12616]: s1 renewed 1146583 delta_length 4 interval 42 >2023-03-27 21:14:27 1146587 [30594]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:27 1146587 [3645]: cmd_set_lvb ci 4 fd 16 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK >2023-03-27 21:14:27 1146587 [3645]: cmd_release 3,10,12513 ci_in 3 fd 10 count 1 flags 0 >2023-03-27 21:14:27 1146587 [3645]: s2:r4 release_token r_flags 28 lver 1918219 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 write_host_block host_id 71 flags 0 gen 0 dblock 140592393246071:0:0:0:0:1918219:RELEASED. >2023-03-27 21:14:28 1146588 [3645]: s2:r4 paxos_release leader 1918219 owner 71 1 1146528 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 paxos_release skip write last lver 1918219 owner 71 1 1146528 writer 90 1 1147252 disk lver 1918219 owner 71 1 1146528 writer 90 1 1147252 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 release_token done r_flags 28 >2023-03-27 21:14:28 1146588 [3645]: cmd_release 3,10,12513 result 0 pid_dead 0 count 1 >2023-03-27 21:14:28 1146588 [3645]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 leader 1918219 dblocks 1:140592393246002:0:0:0:0:1918219:0,55:140592393244056:0:0:0:0:1918219:0,57:140592393246058:140592393246058:71:1:1146528:1918219:0,60:140592393246061:0:0:0:0:1918219:0, >2023-03-27 21:14:28 1146588 [3645]: s2:r4 leader 1918219 owner 71 1 1146528 dblocks 70:140592393246071:0:0:0:0:1918219:1,89:140592393246090:140592393246090:71:1:1146528:1918219:0, >2023-03-27 21:14:28 1146588 [3645]: s2:r4 paxos_acquire leader 1918219 owner 71 1 1146528 max mbal[89] 140592393246090 our_dblock 140592393246071 0 0 0 0 1918219 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 paxos_acquire owner 71 1 1146528 is already local 71 1 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 ballot 1918220 phase1 write mbal 140592393248071 >2023-03-27 21:14:28 1146588 [3645]: s2:r4 ballot 1918220 phase1 read 54:140592393248055:0:0:0:0:1918220:0,63:140592393248064:0:0:0:0:1918220:0,70:140592393248071:0:0:0:0:1918220:0, >2023-03-27 21:14:28 1146588 [3645]: s2:r4 ballot 1918220 phase2 write bal 140592393248071 inp 71 1 1146588 q_max -1 >2023-03-27 21:14:29 1146589 [3645]: s2:r4 ballot 1918220 phase2 read 1:140592393248002:0:0:0:0:1918220:0,54:140592393248055:0:0:0:0:1918220:0,63:140592393248064:0:0:0:0:1918220:0,70:140592393248071:140592393248071:71:1:1146588:1918220:0, >2023-03-27 21:14:29 1146589 [3645]: s2:r4 ballot 1918220 commit self owner 71 1 1146588 >2023-03-27 21:14:29 1146589 [3645]: s2:r4 acquire_disk rv 1 lver 1918220 at 1146588 >2023-03-27 21:14:29 1146589 [3645]: cmd_acquire 3,10,12513 result 0 pid_dead 0 >2023-03-27 21:14:29 1146589 [3645]: cmd_get_lvb ci 4 fd 16 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK >2023-03-27 21:14:29 1146589 [30594]: s1:r2 acquire_disk rv -243 lver 1886512 at 1146760 >2023-03-27 21:14:29 1146589 [30594]: s1:r2 acquire_token held error -243 >2023-03-27 21:14:29 1146589 [30594]: s1:r2 release_token r_flags 8 lver 0 >2023-03-27 21:14:29 1146589 [30594]: s1:r2 release_token done r_flags 8 >2023-03-27 21:14:29 1146589 [30594]: s1:r2 cmd_acquire 2,9,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:29 1146589 [30594]: cmd_acquire 2,9,12513 result -243 pid_dead 0 >2023-03-27 21:14:29 1146589 [3645]: cmd_acquire 2,9,12513 ci_in 2 fd 9 count 1 flags 9 >2023-03-27 21:14:29 1146589 [3645]: s1:r2 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:31 1146590 [30594]: cmd_release 3,10,12513 ci_in 3 fd 10 count 1 flags 0 >2023-03-27 21:14:31 1146590 [30594]: s2:r4 release_token r_flags 8 lver 1918220 >2023-03-27 21:14:31 1146591 [30594]: s2:r4 write_host_block host_id 71 flags 0 gen 0 dblock 140592393248071:140592393248071:71:1:1146588:1918220:RELEASED. >2023-03-27 21:14:31 1146591 [30594]: s2:r4 paxos_release leader 1918220 owner 71 1 1146588 >2023-03-27 21:14:31 1146591 [3645]: s1:r2 leader 1886512 owner 92 1 1146760 dblocks 90:4379908091:0:0:0:0:1886512:0,91:4379908092:4379908092:92:1:1146760:1886512:1, >2023-03-27 21:14:31 1146591 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 max mbal[91] 4379908092 our_dblock 0 0 0 0 0 0 >2023-03-27 21:14:31 1146591 [3645]: s1:r2 paxos_acquire owner 92 1 1146760 host_status 92 1 1146762 wait_start 1146586 >2023-03-27 21:14:31 1146591 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:14:31 1146591 [30594]: cmd_release 3,10,12513 result 0 pid_dead 0 count 1 >2023-03-27 21:14:31 1146591 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:31 1146591 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:31 1146591 [30594]: s2:r4 leader 1918220 dblocks 1:140592393248002:0:0:0:0:1918220:0,54:140592393248055:0:0:0:0:1918220:0,60:140592393248061:0:0:0:0:1918220:0,63:140592393248064:0:0:0:0:1918220:0, >2023-03-27 21:14:31 1146591 [30594]: s2:r4 leader 1918220 owner 71 1 0 dblocks 70:140592393248071:140592393248071:71:1:1146588:1918220:1, >2023-03-27 21:14:31 1146591 [30594]: s2:r4 paxos_acquire leader 1918220 owner 71 1 0 max mbal[70] 140592393248071 our_dblock 140592393248071 140592393248071 71 1 1146588 1918220 >2023-03-27 21:14:31 1146591 [30594]: s2:r4 paxos_acquire leader 1918220 free >2023-03-27 21:14:31 1146591 [30594]: s2:r4 ballot 1918221 phase1 write mbal 140592393250071 >2023-03-27 21:14:32 1146592 [30594]: s2:r4 ballot 1918221 abort1 larger mbal in bk[89] 140592393252090:0:0:0:0:1918221 our dblock 140592393250071:0:0:0:0:1918221 >2023-03-27 21:14:32 1146592 [30594]: s2:r4 ballot 1918221 phase1 read 1:140592393250002:0:0:0:0:1918221:0,57:140592393250058:0:0:0:0:1918221:0,70:140592393250071:0:0:0:0:1918221:0,89:140592393252090:0:0:0:0:1918221:0, >2023-03-27 21:14:32 1146592 [30594]: s2:r4 paxos_acquire 1918221 retry delay 250140 us >2023-03-27 21:14:33 1146592 [30594]: s2:r4 paxos_acquire leader 1918221 owner 97 1 1147776 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 paxos_acquire 1918221 owner is 97 1 1147776 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 acquire_disk rv -244 lver 1918221 at 1147776 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 acquire_token held error -244 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:14:33 1146592 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -244 lease owned by other host >2023-03-27 21:14:33 1146592 [30594]: cmd_acquire 3,10,12513 result -244 pid_dead 0 >2023-03-27 21:14:34 1146593 [3645]: s1:r2 paxos_acquire owner 92 delta 92 1 1146762 alive >2023-03-27 21:14:34 1146593 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:34 1146593 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:35 1146595 [30594]: s2:r4 leader 1918221 dblocks 1:140592393252002:0:0:0:0:1918221:0,8:140592393254009:0:0:0:0:1918221:0,54:140592393254055:0:0:0:0:1918221:0,55:140592393254056:0:0:0:0:1918221:0, >2023-03-27 21:14:35 1146595 [30594]: s2:r4 leader 1918221 dblocks 57:140592393250058:0:0:0:0:1918221:0,60:140592393254061:0:0:0:0:1918221:0,63:140592393254064:140592393254064:97:1:1147776:1918221:0,70:140592393250071:0:0:0:0:1918221:0, >2023-03-27 21:14:35 1146595 [30594]: s2:r4 leader 1918221 owner 97 1 1147776 dblocks 89:140592393252090:0:0:0:0:1918221:0,96:140592393252097:140592393252097:97:1:1147776:1918221:0, >2023-03-27 21:14:35 1146595 [30594]: s2:r4 paxos_acquire leader 1918221 owner 97 1 1147776 max mbal[63] 140592393254064 our_dblock 140592393250071 0 0 0 0 1918221 >2023-03-27 21:14:35 1146595 [30594]: s2:r4 paxos_acquire owner 97 1 1147776 host_status 97 1 1147719 wait_start 1146563 >2023-03-27 21:14:35 1146595 [30594]: s2:r4 paxos_acquire owner 97 delta 97 1 1147765 alive >2023-03-27 21:14:36 1146595 [30594]: s2:r4 paxos_acquire owner 97 1 1147776 writer 64 owner dblock released >2023-03-27 21:14:36 1146596 [3645]: s1:r2 paxos_acquire owner 92 1 1146760 writer 101 owner dblock released >2023-03-27 21:14:36 1146596 [30594]: s2:r4 paxos_acquire leader 1918221 owner 97 1 1147776 >2023-03-27 21:14:36 1146596 [30594]: s2:r4 ballot 1918222 phase1 write mbal 140592393256071 >2023-03-27 21:14:36 1146596 [30594]: s2:r4 ballot 1918222 phase1 read 1:140592393256002:0:0:0:0:1918222:0,8:140592393256009:0:0:0:0:1918222:0,60:140592393256061:0:0:0:0:1918222:0,63:140592393256064:0:0:0:0:1918222:0, >2023-03-27 21:14:36 1146596 [30594]: s2:r4 ballot 1918222 phase1 read 70:140592393256071:0:0:0:0:1918222:0, >2023-03-27 21:14:36 1146596 [30594]: s2:r4 ballot 1918222 phase2 write bal 140592393256071 inp 71 1 1146596 q_max -1 >2023-03-27 21:14:37 1146597 [30594]: s2:r4 ballot 1918222 phase2 read 1:140592393256002:0:0:0:0:1918222:0,8:140592393256009:0:0:0:0:1918222:0,55:140592393256056:0:0:0:0:1918222:0,60:140592393256061:0:0:0:0:1918222:0, >2023-03-27 21:14:37 1146597 [30594]: s2:r4 ballot 1918222 abort2 larger mbal in bk[89] 140592393256090:0:0:0:0:1918222 our dblock 140592393256071:140592393256071:71:1:1146596:1918222 >2023-03-27 21:14:37 1146597 [30594]: s2:r4 ballot 1918222 phase2 read 63:140592393256064:0:0:0:0:1918222:0,70:140592393256071:140592393256071:71:1:1146596:1918222:0,89:140592393256090:0:0:0:0:1918222:0, >2023-03-27 21:14:37 1146597 [30594]: s2:r4 paxos_acquire 1918222 retry delay 177379 us >2023-03-27 21:14:37 1146597 [30594]: s2:r4 paxos_acquire leader 1918221 owner 97 1 1147776 >2023-03-27 21:14:37 1146597 [30594]: s2:r4 ballot 1918222 phase1 write mbal 140592393258071 >2023-03-27 21:14:38 1146597 [30594]: s2:r4 ballot 1918222 phase1 read 1:140592393258002:0:0:0:0:1918222:0,8:140592393258009:0:0:0:0:1918222:0,54:140592393258055:0:0:0:0:1918222:0,55:140592393256056:0:0:0:0:1918222:0, >2023-03-27 21:14:38 1146597 [30594]: s2:r4 ballot 1918222 phase1 read 57:140592393258058:0:0:0:0:1918222:0,59:140592393258060:0:0:0:0:1918222:0,60:140592393258061:0:0:0:0:1918222:0,63:140592393258064:140592393258064:71:1:1146596:1918222:0, >2023-03-27 21:14:38 1146597 [30594]: s2:r4 ballot 1918222 phase1 read 70:140592393258071:0:0:0:0:1918222:0,89:140592393256090:0:0:0:0:1918222:0,96:140592393256097:0:0:0:0:1918222:0, >2023-03-27 21:14:38 1146597 [30594]: s2:r4 ballot 1918222 choose bk_max[63] lver 1918222 mbal 140592393258064 bal 140592393258064 inp 71 1 1146596 >2023-03-27 21:14:38 1146597 [30594]: s2:r4 ballot 1918222 phase2 write bal 140592393258071 inp 71 1 1146596 q_max 63 >2023-03-27 21:14:38 1146598 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 >2023-03-27 21:14:38 1146598 [3645]: s1:r2 ballot 1886513 phase1 write mbal 4379910101 >2023-03-27 21:14:38 1146598 [30594]: s2:r4 ballot 1918222 abort2 larger mbal in bk[1] 140592393260002:0:0:0:0:1918222 our dblock 140592393258071:140592393258071:71:1:1146596:1918222 >2023-03-27 21:14:38 1146598 [30594]: s2:r4 ballot 1918222 phase2 read 1:140592393260002:0:0:0:0:1918222:0, >2023-03-27 21:14:38 1146598 [30594]: s2:r4 paxos_acquire 1918222 retry delay 680027 us >2023-03-27 21:14:39 1146599 [30594]: s2:r4 paxos_acquire leader 1918221 owner 97 1 1147776 >2023-03-27 21:14:39 1146599 [30594]: s2:r4 ballot 1918222 phase1 write mbal 140592393260071 >2023-03-27 21:14:40 1146599 [30594]: s2:r4 ballot 1918222 abort1 larger mbal in bk[1] 140592393262002:140592393262002:71:1:1146596:1918222 our dblock 140592393260071:0:0:0:0:1918222 >2023-03-27 21:14:40 1146599 [30594]: s2:r4 ballot 1918222 phase1 read 1:140592393262002:140592393262002:71:1:1146596:1918222:0, >2023-03-27 21:14:40 1146599 [30594]: s2:r4 paxos_acquire 1918222 retry delay 984365 us >2023-03-27 21:14:41 1146600 [17240]: s2 delta_renew begin read >2023-03-27 21:14:41 1146600 [30594]: s2:r4 paxos_acquire leader 1918222 owner 71 1 1146596 >2023-03-27 21:14:41 1146600 [30594]: s2:r4 paxos_acquire 1918222 owner is our inp 71 1 1146596 committed by 64 >2023-03-27 21:14:41 1146600 [30594]: s2:r4 acquire_disk rv 1 lver 1918222 at 1146596 >2023-03-27 21:14:41 1146601 [17240]: s2 delta_renew begin write for new ts 1146601 >2023-03-27 21:14:41 1146601 [30594]: cmd_acquire 3,10,12513 result 0 pid_dead 0 >2023-03-27 21:14:41 1146601 [30594]: cmd_get_lvb ci 4 fd 15 result 0 res lvm_e9df937928e3456fb4d2a92e0756cc0a:VGLK >2023-03-27 21:14:41 1146601 [17240]: s2 renewed 1146601 delta_length 1 interval 41 >2023-03-27 21:14:42 1146602 [3645]: s1:r2 ballot 1886513 phase1 read 12:4379910013:0:0:0:0:1886513:0,20:4379910021:0:0:0:0:1886513:0,31:4379910032:0:0:0:0:1886513:0,39:4379910040:0:0:0:0:1886513:0, >2023-03-27 21:14:42 1146602 [3645]: s1:r2 ballot 1886513 phase1 read 44:4379910045:0:0:0:0:1886513:0,45:4379910046:0:0:0:0:1886513:0,46:4379910047:0:0:0:0:1886513:0,80:4379910081:0:0:0:0:1886513:0, >2023-03-27 21:14:42 1146602 [3645]: s1:r2 ballot 1886513 abort1 larger mbal in bk[82] 4379912083:0:0:0:0:1886513 our dblock 4379910101:0:0:0:0:1886513 >2023-03-27 21:14:42 1146602 [3645]: s1:r2 ballot 1886513 phase1 read 82:4379912083:0:0:0:0:1886513:0, >2023-03-27 21:14:42 1146602 [3645]: s1:r2 paxos_acquire 1886513 retry delay 92662 us >2023-03-27 21:14:44 1146604 [3645]: s1:r2 paxos_acquire leader 1886512 owner 92 1 1146760 >2023-03-27 21:14:44 1146604 [3645]: s1:r2 ballot 1886513 phase1 write mbal 4379912101 >2023-03-27 21:14:47 1146607 [30594]: cmd_release 3,10,12513 ci_in 3 fd 10 count 1 flags 0 >2023-03-27 21:14:47 1146607 [30594]: s2:r4 release_token r_flags 8 lver 1918222 >2023-03-27 21:14:48 1146607 [30594]: s2:r4 write_host_block host_id 71 flags 0 gen 0 dblock 140592393260071:0:0:0:0:1918222:RELEASED. >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_release leader 1918222 owner 71 1 1146596 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_release skip write last lver 1918222 owner 71 1 1146596 writer 64 1 1146994 disk lver 1918222 owner 71 1 1146596 writer 61 1 1146798 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:14:48 1146608 [30594]: cmd_release 3,10,12513 result 0 pid_dead 0 count 1 >2023-03-27 21:14:48 1146608 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 leader 1918222 dblocks 1:140592393262002:140592393262002:71:1:1146596:1918222:0,8:140592393262009:0:0:0:0:1918222:0,28:140592393258029:0:0:0:0:1918222:0,55:140592393260056:0:0:0:0:1918222:0, >2023-03-27 21:14:48 1146608 [30594]: s2:r4 leader 1918222 dblocks 57:140592393262058:0:0:0:0:1918222:0,59:140592393262060:0:0:0:0:1918222:0,60:140592393264061:140592393264061:71:1:1146596:1918222:0,63:140592393262064:140592393262064:71:1:1146596:1918222:0, >2023-03-27 21:14:48 1146608 [30594]: s2:r4 leader 1918222 owner 71 1 1146596 dblocks 70:140592393260071:0:0:0:0:1918222:1,89:140592393260090:0:0:0:0:1918222:0,96:140592393258097:0:0:0:0:1918222:0, >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_acquire leader 1918222 owner 71 1 1146596 max mbal[60] 140592393264061 our_dblock 140592393260071 0 0 0 0 1918222 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_acquire owner 71 1 1146596 is already local 71 1 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 ballot 1918223 phase1 write mbal 140592393266071 >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 phase1 read 12:4379912013:0:0:0:0:1886513:0,20:4379912021:0:0:0:0:1886513:0,31:4379910032:0:0:0:0:1886513:0,39:4379910040:0:0:0:0:1886513:0, >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 phase1 read 44:4379912045:0:0:0:0:1886513:0,45:4379912046:0:0:0:0:1886513:0,46:4379910047:0:0:0:0:1886513:0,50:4379910051:0:0:0:0:1886513:0, >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 phase1 read 71:4379910072:0:0:0:0:1886513:0,80:4379912081:0:0:0:0:1886513:0,82:4379912083:4379912083:92:1:1146795:1886513:0,90:4379910091:0:0:0:0:1886513:0, >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 phase1 read 91:4379910092:4379910092:92:1:1146795:1886513:0,100:4379912101:0:0:0:0:1886513:0, >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 choose bk_max[82] lver 1886513 mbal 4379912083 bal 4379912083 inp 92 1 1146795 >2023-03-27 21:14:48 1146608 [3645]: s1:r2 ballot 1886513 phase2 write bal 4379912101 inp 92 1 1146795 q_max 82 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 ballot 1918223 phase1 read 8:140592393266009:0:0:0:0:1918223:0,59:140592393266060:0:0:0:0:1918223:0,60:140592393266061:0:0:0:0:1918223:0,70:140592393266071:0:0:0:0:1918223:0, >2023-03-27 21:14:48 1146608 [30594]: s2:r4 ballot 1918223 abort1 larger mbal in bk[89] 140592393266090:0:0:0:0:1918223 our dblock 140592393266071:0:0:0:0:1918223 >2023-03-27 21:14:48 1146608 [30594]: s2:r4 ballot 1918223 phase1 read 89:140592393266090:0:0:0:0:1918223:0, >2023-03-27 21:14:48 1146608 [30594]: s2:r4 paxos_acquire 1918223 retry delay 846393 us >2023-03-27 21:14:50 1146609 [30594]: s2:r4 paxos_acquire leader 1918223 owner 61 1 1146805 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 paxos_acquire 1918223 owner is 61 1 1146805 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 acquire_disk rv -244 lver 1918223 at 1146805 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 acquire_token held error -244 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:14:50 1146609 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -244 lease owned by other host >2023-03-27 21:14:50 1146609 [30594]: cmd_acquire 3,10,12513 result -244 pid_dead 0 >2023-03-27 21:14:51 1146610 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:51 1146610 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 leader 1918223 dblocks 8:140592393268009:0:0:0:0:1918223:0,28:140592393266029:0:0:0:0:1918223:0,59:140592393268060:140592393268060:61:1:1146805:1918223:0,60:140592393266061:140592393266061:61:1:1146805:1918223:0, >2023-03-27 21:14:51 1146611 [30594]: s2:r4 leader 1918223 owner 61 1 1146805 dblocks 70:140592393266071:0:0:0:0:1918223:0,89:140592393266090:140592393266090:61:1:1146805:1918223:0,96:140592393266097:0:0:0:0:1918223:0, >2023-03-27 21:14:51 1146611 [30594]: s2:r4 paxos_acquire leader 1918223 owner 61 1 1146805 max mbal[59] 140592393268060 our_dblock 140592393266071 0 0 0 0 1918223 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 paxos_acquire owner 61 1 1146805 host_status 61 1 1146772 wait_start 1146602 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 paxos_acquire owner 61 delta 61 1 1146772 alive >2023-03-27 21:14:51 1146611 [30594]: s2:r4 acquire_disk rv -243 lver 1918223 at 1146805 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 acquire_token held error -243 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 release_token r_flags 8 lver 0 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 release_token done r_flags 8 >2023-03-27 21:14:51 1146611 [30594]: s2:r4 cmd_acquire 3,10,12513 acquire_token -243 lease owned by other host >2023-03-27 21:14:51 1146611 [30594]: cmd_acquire 3,10,12513 result -243 pid_dead 0 >2023-03-27 21:14:52 1146612 [30594]: cmd_acquire 3,10,12513 ci_in 3 fd 10 count 1 flags 9 >2023-03-27 21:14:52 1146612 [30594]: s2:r4 paxos_acquire begin offset 69206016 0xa 512 1048576 >2023-03-27 21:14:52 1146612 [30594]: s2:r4 leader 1918223 dblocks 8:140592393268009:0:0:0:0:1918223:0,28:140592393266029:0:0:0:0:1918223:0,59:140592393268060:140592393268060:61:1:1146805:1918223:0,60:140592393266061:140592393266061:61:1:1146805:1918223:1, >2023-03-27 21:14:52 1146612 [30594]: s2:r4 leader 1918223 owner 61 1 1146805 dblocks 70:140592393266071:0:0:0:0:1918223:0,89:140592393266090:140592393266090:61:1:1146805:1918223:0,96:140592393266097:0:0:0:0:1918223:0, >2023-03-27 21:14:52 1146612 [30594]: s2:r4 paxos_acquire leader 1918223 owner 61 1 1146805 max mbal[59] 140592393268060 our_dblock 140592393266071 0 0 0 0 1918223 >2023-03-27 21:14:52 1146612 [30594]: s2:r4 paxos_acquire owner 61 1 1146805 host_status 61 1 1146772 wait_start 1146602 >2023-03-27 21:14:53 1146612 [30594]: s2:r4 paxos_acquire owner 61 delta 61 1 1146772 alive >2023-03-27 21:14:53 1146613 [30594]: s2:r4 paxos_acquire owner 61 1 1146805 writer 60 owner dblock released >2023-03-27 21:14:53 1146613 [30594]: s2:r4 paxos_acquire leader 1918223 owner 61 1 1146805 >2023-03-27 21:14:53 1146613 [30594]: s2:r4 ballot 1918224 phase1 write mbal 140592393270071 >2023-03-27 21:14:53 1146613 [3645]: s1:r2 ballot 1886513 abort2 larger mbal in bk[20] 4379914021:0:0:0:0:1886513 our dblock 4379912101:4379912101:92:1:1146795:1886513 >2023-03-27 21:14:53 1146613 [3645]: s1:r2 ballot 1886513 phase2 read 12:4379912013:0:0:0:0:1886513:0,20:4379914021:0:0:0:0:1886513:0, >2023-03-27 21:14:53 1146613 [3645]: s1:r2 paxos_acquire 1886513 retry delay 456673 us >2023-03-27 21:14:53 1146613 [30594]: s2:r4 ballot 1918224 abort1 larger mbal in bk[89] 140592393270090:140592393270090:90:1:1147336:1918224 our dblock 140592393270071:0:0:0:0:1918224 >2023-03-27 21:14:53 1146613 [30594]: s2:r4 ballot 1918224 phase1 read 8:140592393270009:0:0:0:0:1918224:0,60:140592393270061:0:0:0:0:1918224:0,70:140592393270071:0:0:0:0:1918224:0,89:140592393270090:140592393270090:90:1:1147336:1918224:0, >2023-03-27 21:14:53 1146613 [30594]: s2:r4 paxos_acquire 1918224 retry delay 342802 us
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 2176424
:
1948968
|
1949192
|
1949193
|
1949194
|
1949197
|
1949823
|
1954340
|
1954341
|
1957424
| 1957425