Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 1445137 Details for
Bug 1583494
heketi create/delete commands are in queue(hang) state
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
heketi pod logs
heketi.log (text/plain), 467.49 KB, created by
Apeksha
on 2018-05-29 06:36:20 UTC
(
hide
)
Description:
heketi pod logs
Filename:
MIME Type:
Creator:
Apeksha
Created:
2018-05-29 06:36:20 UTC
Size:
467.49 KB
patch
obsolete
>Heketi 6.0.0 >[heketi] INFO 2018/05/29 05:02:04 Loaded kubernetes executor >[heketi] ERROR 2018/05/29 05:02:04 /src/github.com/heketi/heketi/apps/glusterfs/app.go:100: invalid log level: >[heketi] INFO 2018/05/29 05:02:04 Block: Auto Create Block Hosting Volume set to true >[heketi] INFO 2018/05/29 05:02:04 Block: New Block Hosting Volume size 500 GB >[heketi] INFO 2018/05/29 05:02:04 GlusterFS Application Loaded >[heketi] INFO 2018/05/29 05:02:04 Started Node Health Cache Monitor >Listening on port 8080 >[heketi] INFO 2018/05/29 05:02:14 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:02:14 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:02:15 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17560 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:02:15 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:02:15 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:02:15 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19170 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:02:15 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:02:15 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:02:15 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 3min 5s ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1120 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:02:15 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:02:15 Cleaned 0 nodes from health cache >[negroni] Started POST /volumes >[heketi] INFO 2018/05/29 05:02:20 Loaded simple allocator >[heketi] INFO 2018/05/29 05:02:20 brick_num: 0 >[negroni] Completed 202 Accepted in 296.655751ms >[asynchttp] INFO 2018/05/29 05:02:20 asynchttp.go:125: Started job 37d51168018c3ee7461c0e014eca7901 >[heketi] INFO 2018/05/29 05:02:20 Started async operation: Create Volume >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 51.355µs >[heketi] INFO 2018/05/29 05:02:20 Creating brick 3296da9ab1b875ec879efd3b9fbe096a >[heketi] INFO 2018/05/29 05:02:20 Creating brick bbf804b332e450ec89e8db251c50022d >[heketi] INFO 2018/05/29 05:02:20 Creating brick c3bdd8f077e7bd5bb3803819b3e31efb >[kubeexec] DEBUG 2018/05/29 05:02:20 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir -p /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: >[kubeexec] DEBUG 2018/05/29 05:02:20 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir -p /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d >Result: >[kubeexec] DEBUG 2018/05/29 05:02:20 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a >Result: >[kubeexec] DEBUG 2018/05/29 05:02:21 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvcreate --poolmetadatasize 53248K -c 256K -L 10485760K -T vg_a65eaec63acb81c24a2f9053ec3afc09/tp_c3bdd8f077e7bd5bb3803819b3e31efb -V 10485760K -n brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_c3bdd8f077e7bd5bb3803819b3e31efb" created. >[kubeexec] DEBUG 2018/05/29 05:02:21 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvcreate --poolmetadatasize 53248K -c 256K -L 10485760K -T vg_44ef3a02b018b9f8855bdb487bda910f/tp_bbf804b332e450ec89e8db251c50022d -V 10485760K -n brick_bbf804b332e450ec89e8db251c50022d >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_bbf804b332e450ec89e8db251c50022d" created. >[kubeexec] DEBUG 2018/05/29 05:02:21 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 53248K -c 256K -L 10485760K -T vg_6d499c3d339689185794d4e0859898a0/tp_3296da9ab1b875ec879efd3b9fbe096a -V 10485760K -n brick_3296da9ab1b875ec879efd3b9fbe096a >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_3296da9ab1b875ec879efd3b9fbe096a" created. >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 38.589µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 74.23µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 72.123µs >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_a65eaec63acb81c24a2f9053ec3afc09-brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: meta-data=/dev/mapper/vg_a65eaec63acb81c24a2f9053ec3afc09-brick_c3bdd8f077e7bd5bb3803819b3e31efb isize=512 agcount=16, agsize=163840 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=2621440, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_bbf804b332e450ec89e8db251c50022d >Result: meta-data=/dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_bbf804b332e450ec89e8db251c50022d isize=512 agcount=16, agsize=163840 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=2621440, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: awk "BEGIN {print \"/dev/mapper/vg_a65eaec63acb81c24a2f9053ec3afc09-brick_c3bdd8f077e7bd5bb3803819b3e31efb /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: awk "BEGIN {print \"/dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_bbf804b332e450ec89e8db251c50022d /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 41.871µs >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_a65eaec63acb81c24a2f9053ec3afc09-brick_c3bdd8f077e7bd5bb3803819b3e31efb /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_bbf804b332e450ec89e8db251c50022d /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d >Result: >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_3296da9ab1b875ec879efd3b9fbe096a >Result: meta-data=/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_3296da9ab1b875ec879efd3b9fbe096a isize=512 agcount=16, agsize=163840 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=2621440, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:02:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: chown :2000 /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: chown :2000 /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_3296da9ab1b875ec879efd3b9fbe096a /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: chmod 2775 /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: chmod 2775 /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_3296da9ab1b875ec879efd3b9fbe096a /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: chown :2000 /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:02:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: chmod 2775 /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a/brick >Result: >[cmdexec] INFO 2018/05/29 05:02:25 Creating volume vol_bbe0acc1b31f34ceef15a83eeb2a5706 replica 3 >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 30.263µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 63.012µs >[kubeexec] DEBUG 2018/05/29 05:02:27 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume create vol_bbe0acc1b31f34ceef15a83eeb2a5706 replica 3 10.70.46.85:/var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a/brick 10.70.46.238:/var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb/brick 10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d/brick >Result: volume create: vol_bbe0acc1b31f34ceef15a83eeb2a5706: success: please start the volume to access data >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 68.797µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 68.299µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 35.678µs >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 38.81µs >[kubeexec] DEBUG 2018/05/29 05:02:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume start vol_bbe0acc1b31f34ceef15a83eeb2a5706 >Result: volume start: vol_bbe0acc1b31f34ceef15a83eeb2a5706: success >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 200 OK in 39.592µs >[heketi] INFO 2018/05/29 05:02:31 Create Volume succeeded >[asynchttp] INFO 2018/05/29 05:02:31 asynchttp.go:129: Completed job 37d51168018c3ee7461c0e014eca7901 in 11.101121908s >[negroni] Started GET /queue/37d51168018c3ee7461c0e014eca7901 >[negroni] Completed 303 See Other in 90.009µs >[negroni] Started GET /volumes/bbe0acc1b31f34ceef15a83eeb2a5706 >[negroni] Completed 200 OK in 3.983913ms >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 360.791µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 942.965µs >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 577.816µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 532.687µs >[negroni] Started DELETE /volumes/bbe0acc1b31f34ceef15a83eeb2a5706 >[heketi] INFO 2018/05/29 05:03:59 Loaded simple allocator >[negroni] Completed 202 Accepted in 126.126609ms >[asynchttp] INFO 2018/05/29 05:03:59 asynchttp.go:125: Started job d88af40a1fc2bc7fca7d18b5d2cf994f >[heketi] INFO 2018/05/29 05:03:59 Started async operation: Delete Volume >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 32.202µs >[kubeexec] DEBUG 2018/05/29 05:03:59 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script snapshot list vol_bbe0acc1b31f34ceef15a83eeb2a5706 --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <snapList> > <count>0</count> > </snapList> ></cliOutput> >[kubeexec] DEBUG 2018/05/29 05:03:59 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_66e9fe793b177e278b7747796b0e8574: > brick_f02ab5738a7b55c4c4d4d0d857c00681: > tp_66e9fe793b177e278b7747796b0e8574:1 > tp_f02ab5738a7b55c4c4d4d0d857c00681:1 > brick_c3bdd8f077e7bd5bb3803819b3e31efb: > tp_c3bdd8f077e7bd5bb3803819b3e31efb:1 >[kubeexec] DEBUG 2018/05/29 05:03:59 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_210971d929f335f169e239d17cc4a12a: > brick_bbf804b332e450ec89e8db251c50022d: > tp_210971d929f335f169e239d17cc4a12a:1 > tp_bbf804b332e450ec89e8db251c50022d:1 > brick_bf25e223cb1b70b3e835fbb0c5785e22: > tp_bf25e223cb1b70b3e835fbb0c5785e22:1 >[kubeexec] DEBUG 2018/05/29 05:03:59 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_158723f37f7f135acca3015abe2454fb: > tp_158723f37f7f135acca3015abe2454fb:1 > brick_3296da9ab1b875ec879efd3b9fbe096a: > brick_93e4e31935a3e240c7146926523baf00: > tp_3296da9ab1b875ec879efd3b9fbe096a:1 > tp_93e4e31935a3e240c7146926523baf00:1 >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 58.471µs >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 55.217µs >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 43.08µs >[kubeexec] DEBUG 2018/05/29 05:04:02 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume stop vol_bbe0acc1b31f34ceef15a83eeb2a5706 force >Result: volume stop: vol_bbe0acc1b31f34ceef15a83eeb2a5706: success >[negroni] Started DELETE /volumes/2c3843039bb3efdd3a87c43bfebee042 >[heketi] INFO 2018/05/29 05:04:02 Loaded simple allocator >[kubeexec] DEBUG 2018/05/29 05:04:02 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume delete vol_bbe0acc1b31f34ceef15a83eeb2a5706 >Result: volume delete: vol_bbe0acc1b31f34ceef15a83eeb2a5706: success >[heketi] INFO 2018/05/29 05:04:02 Deleting brick 3296da9ab1b875ec879efd3b9fbe096a >[heketi] INFO 2018/05/29 05:04:02 Deleting brick bbf804b332e450ec89e8db251c50022d >[heketi] INFO 2018/05/29 05:04:02 Deleting brick c3bdd8f077e7bd5bb3803819b3e31efb >[negroni] Completed 202 Accepted in 144.368781ms >[asynchttp] INFO 2018/05/29 05:04:02 asynchttp.go:125: Started job db3f19534c06b290a7ec39149b5ff772 >[heketi] INFO 2018/05/29 05:04:02 Started async operation: Delete Volume >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 46.567µs >[kubeexec] DEBUG 2018/05/29 05:04:02 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: umount /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d >Result: >[kubeexec] DEBUG 2018/05/29 05:04:02 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: umount /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: >[kubeexec] DEBUG 2018/05/29 05:04:02 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: umount /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a >Result: >[kubeexec] DEBUG 2018/05/29 05:04:03 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script snapshot list vol_2c3843039bb3efdd3a87c43bfebee042 --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <snapList> > <count>0</count> > </snapList> ></cliOutput> >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 50.958µs >[kubeexec] DEBUG 2018/05/29 05:04:03 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvremove -f vg_44ef3a02b018b9f8855bdb487bda910f/tp_bbf804b332e450ec89e8db251c50022d >Result: Logical volume "brick_bbf804b332e450ec89e8db251c50022d" successfully removed > Logical volume "tp_bbf804b332e450ec89e8db251c50022d" successfully removed >[kubeexec] DEBUG 2018/05/29 05:04:03 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvremove -f vg_6d499c3d339689185794d4e0859898a0/tp_3296da9ab1b875ec879efd3b9fbe096a >Result: Logical volume "brick_3296da9ab1b875ec879efd3b9fbe096a" successfully removed > Logical volume "tp_3296da9ab1b875ec879efd3b9fbe096a" successfully removed >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 57.137µs >[kubeexec] DEBUG 2018/05/29 05:04:03 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvremove -f vg_a65eaec63acb81c24a2f9053ec3afc09/tp_c3bdd8f077e7bd5bb3803819b3e31efb >Result: Logical volume "brick_c3bdd8f077e7bd5bb3803819b3e31efb" successfully removed > Logical volume "tp_c3bdd8f077e7bd5bb3803819b3e31efb" successfully removed >[kubeexec] DEBUG 2018/05/29 05:04:04 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_210971d929f335f169e239d17cc4a12a: > tp_210971d929f335f169e239d17cc4a12a:1 > brick_bf25e223cb1b70b3e835fbb0c5785e22: > tp_bf25e223cb1b70b3e835fbb0c5785e22:1 >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 30.973µs >[kubeexec] DEBUG 2018/05/29 05:04:04 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_158723f37f7f135acca3015abe2454fb: > tp_158723f37f7f135acca3015abe2454fb:1 > brick_93e4e31935a3e240c7146926523baf00: > tp_93e4e31935a3e240c7146926523baf00:1 >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 62.234µs >[heketi] INFO 2018/05/29 05:04:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:04:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:04:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_66e9fe793b177e278b7747796b0e8574: > brick_f02ab5738a7b55c4c4d4d0d857c00681: > tp_66e9fe793b177e278b7747796b0e8574:1 > tp_f02ab5738a7b55c4c4d4d0d857c00681:1 >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 48.038µs >[kubeexec] DEBUG 2018/05/29 05:04:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: rmdir /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_bbf804b332e450ec89e8db251c50022d >Result: >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 59.664µs >[kubeexec] DEBUG 2018/05/29 05:04:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_3296da9ab1b875ec879efd3b9fbe096a >Result: >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 41.53µs >[kubeexec] DEBUG 2018/05/29 05:04:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: rmdir /var/lib/heketi/mounts/vg_a65eaec63acb81c24a2f9053ec3afc09/brick_c3bdd8f077e7bd5bb3803819b3e31efb >Result: >[kubeexec] DEBUG 2018/05/29 05:04:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17900 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:04:06 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:04:06 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 29.773µs >[kubeexec] DEBUG 2018/05/29 05:04:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_3296da9ab1b875ec879efd3b9fbe096a/d" /var/lib/heketi/fstab >Result: >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 36.352µs >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 37.251µs >[kubeexec] DEBUG 2018/05/29 05:04:07 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: sed -i.save "/brick_bbf804b332e450ec89e8db251c50022d/d" /var/lib/heketi/fstab >Result: >[kubeexec] DEBUG 2018/05/29 05:04:07 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19563 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:04:07 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:04:07 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 38.329µs >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 37.224µs >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 200 OK in 55.125µs >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 28.519µs >[kubeexec] DEBUG 2018/05/29 05:04:09 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script volume stop vol_2c3843039bb3efdd3a87c43bfebee042 force >Result: volume stop: vol_2c3843039bb3efdd3a87c43bfebee042: success >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: sed -i.save "/brick_c3bdd8f077e7bd5bb3803819b3e31efb/d" /var/lib/heketi/fstab >Result: >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 5min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1606 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:04:10 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:04:10 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:04:10 Delete Volume succeeded >[asynchttp] INFO 2018/05/29 05:04:10 asynchttp.go:129: Completed job d88af40a1fc2bc7fca7d18b5d2cf994f in 10.958879403s >[negroni] Started GET /queue/d88af40a1fc2bc7fca7d18b5d2cf994f >[negroni] Completed 204 No Content in 60.118µs >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script volume delete vol_2c3843039bb3efdd3a87c43bfebee042 >Result: volume delete: vol_2c3843039bb3efdd3a87c43bfebee042: success >[heketi] INFO 2018/05/29 05:04:10 Deleting brick 93e4e31935a3e240c7146926523baf00 >[heketi] INFO 2018/05/29 05:04:10 Deleting brick bf25e223cb1b70b3e835fbb0c5785e22 >[heketi] INFO 2018/05/29 05:04:10 Deleting brick 66e9fe793b177e278b7747796b0e8574 >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 49.043µs >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: umount /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_bf25e223cb1b70b3e835fbb0c5785e22 >Result: >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: umount /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_66e9fe793b177e278b7747796b0e8574 >Result: >[kubeexec] DEBUG 2018/05/29 05:04:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: umount /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_93e4e31935a3e240c7146926523baf00 >Result: >[kubeexec] DEBUG 2018/05/29 05:04:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvremove -f vg_e0ad7d31cffddba562fbaaef16cad6ae/tp_bf25e223cb1b70b3e835fbb0c5785e22 >Result: Logical volume "brick_bf25e223cb1b70b3e835fbb0c5785e22" successfully removed > Logical volume "tp_bf25e223cb1b70b3e835fbb0c5785e22" successfully removed >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 33.255µs >[kubeexec] DEBUG 2018/05/29 05:04:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvremove -f vg_456a280ec02d926fc470e6db5c895737/tp_66e9fe793b177e278b7747796b0e8574 >Result: Logical volume "brick_66e9fe793b177e278b7747796b0e8574" successfully removed > Logical volume "tp_66e9fe793b177e278b7747796b0e8574" successfully removed >[kubeexec] DEBUG 2018/05/29 05:04:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvremove -f vg_6d499c3d339689185794d4e0859898a0/tp_93e4e31935a3e240c7146926523baf00 >Result: Logical volume "brick_93e4e31935a3e240c7146926523baf00" successfully removed > Logical volume "tp_93e4e31935a3e240c7146926523baf00" successfully removed >[kubeexec] DEBUG 2018/05/29 05:04:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: rmdir /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_bf25e223cb1b70b3e835fbb0c5785e22 >Result: >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 51.557µs >[kubeexec] DEBUG 2018/05/29 05:04:12 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: rmdir /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_66e9fe793b177e278b7747796b0e8574 >Result: >[kubeexec] DEBUG 2018/05/29 05:04:12 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_93e4e31935a3e240c7146926523baf00 >Result: >[kubeexec] DEBUG 2018/05/29 05:04:13 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: sed -i.save "/brick_bf25e223cb1b70b3e835fbb0c5785e22/d" /var/lib/heketi/fstab >Result: >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 200 OK in 33.928µs >[kubeexec] DEBUG 2018/05/29 05:04:13 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: sed -i.save "/brick_66e9fe793b177e278b7747796b0e8574/d" /var/lib/heketi/fstab >Result: >[kubeexec] DEBUG 2018/05/29 05:04:13 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_93e4e31935a3e240c7146926523baf00/d" /var/lib/heketi/fstab >Result: >[heketi] INFO 2018/05/29 05:04:14 Delete Volume succeeded >[asynchttp] INFO 2018/05/29 05:04:14 asynchttp.go:129: Completed job db3f19534c06b290a7ec39149b5ff772 in 11.545987427s >[negroni] Started GET /queue/db3f19534c06b290a7ec39149b5ff772 >[negroni] Completed 204 No Content in 39.508µs >[heketi] INFO 2018/05/29 05:06:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:06:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:06:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:06:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:06:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:06:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:06:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:06:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:06:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 6min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:06:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:06:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:08:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:08:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:08:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:08:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:08:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:08:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:08:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:08:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:08:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 8min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:08:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:08:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:10:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:10:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:10:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:10:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:10:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:10:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:10:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:10:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:10:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 10min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:10:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:10:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:12:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:12:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:12:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:12:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:12:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:12:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:12:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:12:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:12:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 12min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:12:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:12:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:14:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:14:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:14:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:14:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:14:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:14:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:14:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:14:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:14:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 14min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:14:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:14:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:16:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:16:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:16:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:16:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:16:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:16:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:16:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:16:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:16:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 16min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:16:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:16:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:18:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:18:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:18:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:18:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:18:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:18:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:18:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:18:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:18:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 18min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:18:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:18:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:20:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:20:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:20:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:20:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:20:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:20:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 11h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:20:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:20:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:20:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 20min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:20:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:20:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:22:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:22:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:22:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:22:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:22:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:22:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:22:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:22:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:22:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 22min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:22:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:22:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:24:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:24:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:24:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:24:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:24:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:24:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:24:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:24:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:24:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 24min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:24:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:24:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:26:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:26:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:26:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:26:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:26:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:26:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:26:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:26:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:26:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 26min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:26:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:26:05 Cleaned 0 nodes from health cache >[heketi] INFO 2018/05/29 05:28:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:28:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:28:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ17978 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:28:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:28:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:28:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19658 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:28:05 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:28:05 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:28:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 28min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ1607 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:28:05 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:28:05 Cleaned 0 nodes from health cache >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 1.329639ms >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 923.506µs >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 229.383µs >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 306.031µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 2.581861ms >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 2.126155ms >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 411.47µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 428.83µs >[negroni] Started POST /volumes >[heketi] INFO 2018/05/29 05:29:28 Loaded simple allocator >[heketi] INFO 2018/05/29 05:29:28 brick_num: 0 >[asynchttp] INFO 2018/05/29 05:29:28 asynchttp.go:125: Started job a2728acf60197fee949642ad2209fe75 >[heketi] INFO 2018/05/29 05:29:28 Started async operation: Create Volume >[negroni] Completed 202 Accepted in 94.090247ms >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 31.832µs >[heketi] INFO 2018/05/29 05:29:28 Creating brick 4f96665a9d143e46fa69b9f56ec9d1e4 >[heketi] INFO 2018/05/29 05:29:28 Creating brick 4f14ad754a1bc2d2b686532e12bd7a1e >[heketi] INFO 2018/05/29 05:29:28 Creating brick 29b3531a9e56da0b2d88028ea4286b28 >[kubeexec] DEBUG 2018/05/29 05:29:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir -p /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir -p /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e >Result: >[kubeexec] DEBUG 2018/05/29 05:29:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_44ef3a02b018b9f8855bdb487bda910f/tp_4f96665a9d143e46fa69b9f56ec9d1e4 -V 1048576K -n brick_4f96665a9d143e46fa69b9f56ec9d1e4 >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_4f96665a9d143e46fa69b9f56ec9d1e4" created. >[kubeexec] DEBUG 2018/05/29 05:29:29 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_456a280ec02d926fc470e6db5c895737/tp_4f14ad754a1bc2d2b686532e12bd7a1e -V 1048576K -n brick_4f14ad754a1bc2d2b686532e12bd7a1e >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_4f14ad754a1bc2d2b686532e12bd7a1e" created. >[kubeexec] DEBUG 2018/05/29 05:29:29 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_5992fad049cde25f1eb1aab0c0cdee9a/tp_29b3531a9e56da0b2d88028ea4286b28 -V 1048576K -n brick_29b3531a9e56da0b2d88028ea4286b28 >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_29b3531a9e56da0b2d88028ea4286b28" created. >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 38.027µs >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 52.331µs >[kubeexec] DEBUG 2018/05/29 05:29:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_4f96665a9d143e46fa69b9f56ec9d1e4 >Result: meta-data=/dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_4f96665a9d143e46fa69b9f56ec9d1e4 isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:29:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: awk "BEGIN {print \"/dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_4f96665a9d143e46fa69b9f56ec9d1e4 /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4 xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:29:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_4f14ad754a1bc2d2b686532e12bd7a1e >Result: meta-data=/dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_4f14ad754a1bc2d2b686532e12bd7a1e isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:29:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_29b3531a9e56da0b2d88028ea4286b28 >Result: meta-data=/dev/mapper/vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_29b3531a9e56da0b2d88028ea4286b28 isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: awk "BEGIN {print \"/dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_4f14ad754a1bc2d2b686532e12bd7a1e /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_29b3531a9e56da0b2d88028ea4286b28 /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28 xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 56.348µs >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_44ef3a02b018b9f8855bdb487bda910f-brick_4f96665a9d143e46fa69b9f56ec9d1e4 /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_4f14ad754a1bc2d2b686532e12bd7a1e /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_29b3531a9e56da0b2d88028ea4286b28 /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:29:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick >Result: >[cmdexec] INFO 2018/05/29 05:29:31 Creating volume vol_3d8325d2095c5196c321cddfd7e3eaea replica 3 >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 36.716µs >[kubeexec] DEBUG 2018/05/29 05:29:32 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: gluster --mode=script volume create vol_3d8325d2095c5196c321cddfd7e3eaea replica 3 10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick 10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick 10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick >Result: volume create: vol_3d8325d2095c5196c321cddfd7e3eaea: success: please start the volume to access data >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 49.502µs >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 95.958µs >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 200 OK in 71.481µs >[kubeexec] DEBUG 2018/05/29 05:29:35 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: gluster --mode=script volume start vol_3d8325d2095c5196c321cddfd7e3eaea >Result: volume start: vol_3d8325d2095c5196c321cddfd7e3eaea: success >[heketi] INFO 2018/05/29 05:29:35 Create Volume succeeded >[asynchttp] INFO 2018/05/29 05:29:35 asynchttp.go:129: Completed job a2728acf60197fee949642ad2209fe75 in 7.763620212s >[negroni] Started GET /queue/a2728acf60197fee949642ad2209fe75 >[negroni] Completed 303 See Other in 118.555µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 3.290574ms >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 84.164µs >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 310.994µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 902.374µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 832.806µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 1.566974ms >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 821.816µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 629.262µs >[negroni] Started POST /devices >[heketi] INFO 2018/05/29 05:29:36 Adding device /dev/sdf to node e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 202 Accepted in 120.996139ms >[asynchttp] INFO 2018/05/29 05:29:36 asynchttp.go:125: Started job fbe2a90ff57ec2cbe1a8678c999854c5 >[negroni] Started GET /queue/fbe2a90ff57ec2cbe1a8678c999854c5 >[negroni] Completed 200 OK in 45.155µs >[kubeexec] DEBUG 2018/05/29 05:29:37 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: pvcreate --metadatasize=128M --dataalignment=256K '/dev/sdf' >Result: Physical volume "/dev/sdf" successfully created. >[kubeexec] DEBUG 2018/05/29 05:29:37 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: vgcreate vg_2df7febc45419bc0275826cca6842e8a /dev/sdf >Result: Volume group "vg_2df7febc45419bc0275826cca6842e8a" successfully created >[negroni] Started GET /queue/fbe2a90ff57ec2cbe1a8678c999854c5 >[negroni] Completed 200 OK in 49.167µs >[kubeexec] DEBUG 2018/05/29 05:29:37 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: vgdisplay -c vg_2df7febc45419bc0275826cca6842e8a >Result: vg_2df7febc45419bc0275826cca6842e8a:r/w:772:-1:0:0:0:-1:0:1:1:104722432:4096:25567:0:25567:J2By2n-SoGd-cqyz-JsLE-TqDM-pRsd-Q5WVCn >[cmdexec] DEBUG 2018/05/29 05:29:37 /src/github.com/heketi/heketi/executors/cmdexec/device.go:143: Size of /dev/sdf in dhcp46-85.lab.eng.blr.redhat.com is 104722432 >[heketi] INFO 2018/05/29 05:29:37 Added device /dev/sdf >[asynchttp] INFO 2018/05/29 05:29:37 asynchttp.go:129: Completed job fbe2a90ff57ec2cbe1a8678c999854c5 in 1.15617584s >[negroni] Started GET /queue/fbe2a90ff57ec2cbe1a8678c999854c5 >[negroni] Completed 204 No Content in 48.995µs >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 1.566612ms >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 216.703µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 722.858µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 455.101µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 970.95µs >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 578.231µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 443.923µs >[negroni] Started POST /devices/5992fad049cde25f1eb1aab0c0cdee9a/state >[negroni] Completed 202 Accepted in 318.217µs >[asynchttp] INFO 2018/05/29 05:29:38 asynchttp.go:125: Started job 85cf3da5bc6b5cb29c4d336d31087575 >[heketi] INFO 2018/05/29 05:29:38 Loaded simple allocator >[negroni] Started GET /queue/85cf3da5bc6b5cb29c4d336d31087575 >[negroni] Completed 200 OK in 19.23µs >[asynchttp] INFO 2018/05/29 05:29:38 asynchttp.go:129: Completed job 85cf3da5bc6b5cb29c4d336d31087575 in 104.866737ms >[negroni] Started GET /queue/85cf3da5bc6b5cb29c4d336d31087575 >[negroni] Completed 204 No Content in 56.002µs >[negroni] Started POST /devices/5992fad049cde25f1eb1aab0c0cdee9a/state >[negroni] Completed 202 Accepted in 2.14485ms >[asynchttp] INFO 2018/05/29 05:29:39 asynchttp.go:125: Started job e7c165268a7f2d0b578647234fdd3d35 >[heketi] INFO 2018/05/29 05:29:39 Loaded simple allocator >[heketi] INFO 2018/05/29 05:29:39 Running Remove Device >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 54.099µs >[heketi] INFO 2018/05/29 05:29:39 Replacing brick 158723f37f7f135acca3015abe2454fb on device 5992fad049cde25f1eb1aab0c0cdee9a on node e3e6b22f48dd409750f46de51accb317 >[cmdexec] INFO 2018/05/29 05:29:39 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ20544 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[kubeexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume info heketidbstorage --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <volInfo> > <volumes> > <volume> > <name>heketidbstorage</name> > <id>ea656013-270f-49c3-b9c9-5923e8e25dfa</id> > <status>1</status> > <statusStr>Started</statusStr> > <snapshotCount>0</snapshotCount> > <brickCount>3</brickCount> > <distCount>3</distCount> > <stripeCount>1</stripeCount> > <replicaCount>3</replicaCount> > <arbiterCount>0</arbiterCount> > <disperseCount>0</disperseCount> > <redundancyCount>0</redundancyCount> > <type>2</type> > <typeStr>Replicate</typeStr> > <transport>0</transport> > <xlators/> > <bricks> > <brick uuid="60c37b3c-4941-4d65-bbb5-b202132cdb49">10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick<name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick</name><hostUuid>60c37b3c-4941-4d65-bbb5-b202132cdb49</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da">10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick<name>10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick</name><hostUuid>32f2b0d7-37b5-45d2-ab76-d6109ac1a5da</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65">10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick<name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick</name><hostUuid>3ec7eb35-829e-4d15-887c-ead4e78c2f65</hostUuid><isArbiter>0</isArbiter></brick> > </bricks> > <optCount>3</optCount> > <options> > <option> > <name>transport.address-family</name> > <value>inet</value> > </option> > <option> > <name>nfs.disable</name> > <value>on</value> > </option> > <option> > <name>cluster.brick-multiplex</name> > <value>on</value> > </option> > </options> > </volume> > <count>1</count> > </volumes> > </volInfo> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:271: {OpRet:0 OpErrno:0 OpErrStr: VolInfo:{XMLName:{Space: Local:volInfo} Volumes:{XMLName:{Space: Local:volumes} Count:1 VolumeList:[{XMLName:{Space: Local:volume} VolumeName:heketidbstorage ID:ea656013-270f-49c3-b9c9-5923e8e25dfa Status:1 StatusStr:Started BrickCount:3 DistCount:3 StripeCount:1 ReplicaCount:3 ArbiterCount:0 DisperseCount:0 RedundancyCount:0 Type:2 TypeStr:Replicate Transport:0 Bricks:{XMLName:{Space: Local:bricks} BrickList:[{UUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 IsArbiter:0} {UUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da IsArbiter:0} {UUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 IsArbiter:0}]} OptCount:3 Options:{XMLName:{Space: Local:options} OptionList:[{Name:transport.address-family Value:inet} {Name:nfs.disable Value:on} {Name:cluster.brick-multiplex Value:on}]}}]}}} >[kubeexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume heal heketidbstorage info --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <healInfo> > <bricks> > <brick hostUuid="60c37b3c-4941-4d65-bbb5-b202132cdb49"> > <name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da"> > <name>10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65"> > <name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > </bricks> > </healInfo> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:319: {OpRet:0 OpErrno:0 OpErrStr: HealInfo:{XMLName:{Space: Local:healInfo} Bricks:{BrickList:[{HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick Status:Connected NumberOfEntries:0} {HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick Status:Connected NumberOfEntries:0} {HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick Status:Connected NumberOfEntries:0}]}}} >[heketi] INFO 2018/05/29 05:29:40 Creating brick f5e7b6b97f11333944a5806ffef27659 >[kubeexec] DEBUG 2018/05/29 05:29:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659 >Result: >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 35.235µs >[kubeexec] DEBUG 2018/05/29 05:29:41 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 12288K -c 256K -L 2097152K -T vg_2df7febc45419bc0275826cca6842e8a/tp_f5e7b6b97f11333944a5806ffef27659 -V 2097152K -n brick_f5e7b6b97f11333944a5806ffef27659 >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_f5e7b6b97f11333944a5806ffef27659" created. >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 61.272µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 52.756µs >[kubeexec] DEBUG 2018/05/29 05:29:43 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_f5e7b6b97f11333944a5806ffef27659 >Result: meta-data=/dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_f5e7b6b97f11333944a5806ffef27659 isize=512 agcount=8, agsize=65536 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=524288, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:29:43 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_f5e7b6b97f11333944a5806ffef27659 /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659 xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:29:43 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_f5e7b6b97f11333944a5806ffef27659 /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:43 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick >Result: >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 55.104µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 76.315µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 96.862µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 46.333µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 62.995µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 43.838µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 63.114µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 108.599µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 70.884µs >[kubeexec] DEBUG 2018/05/29 05:29:52 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume replace-brick heketidbstorage 10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick 10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick commit force >Result: volume replace-brick: success: replace-brick commit force operation successful >[heketi] INFO 2018/05/29 05:29:52 Deleting brick 158723f37f7f135acca3015abe2454fb >[kubeexec] DEBUG 2018/05/29 05:29:52 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: umount /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb >Result: >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 62.854µs >[kubeexec] DEBUG 2018/05/29 05:29:53 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvremove -f vg_5992fad049cde25f1eb1aab0c0cdee9a/tp_158723f37f7f135acca3015abe2454fb >Result: Logical volume "brick_158723f37f7f135acca3015abe2454fb" successfully removed > Logical volume "tp_158723f37f7f135acca3015abe2454fb" successfully removed >[kubeexec] DEBUG 2018/05/29 05:29:53 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb >Result: >[kubeexec] DEBUG 2018/05/29 05:29:53 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_158723f37f7f135acca3015abe2454fb/d" /var/lib/heketi/fstab >Result: >[heketi] INFO 2018/05/29 05:29:53 replaced brick:158723f37f7f135acca3015abe2454fb on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick with brick:f5e7b6b97f11333944a5806ffef27659 on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick >[heketi] INFO 2018/05/29 05:29:53 Replacing brick 29b3531a9e56da0b2d88028ea4286b28 on device 5992fad049cde25f1eb1aab0c0cdee9a on node e3e6b22f48dd409750f46de51accb317 >[cmdexec] INFO 2018/05/29 05:29:53 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:29:53 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ20776 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 56.668µs >[kubeexec] DEBUG 2018/05/29 05:29:54 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume info vol_3d8325d2095c5196c321cddfd7e3eaea --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <volInfo> > <volumes> > <volume> > <name>vol_3d8325d2095c5196c321cddfd7e3eaea</name> > <id>fef78401-f4a3-4daf-b0aa-ebd056e1fb7a</id> > <status>1</status> > <statusStr>Started</statusStr> > <snapshotCount>0</snapshotCount> > <brickCount>3</brickCount> > <distCount>3</distCount> > <stripeCount>1</stripeCount> > <replicaCount>3</replicaCount> > <arbiterCount>0</arbiterCount> > <disperseCount>0</disperseCount> > <redundancyCount>0</redundancyCount> > <type>2</type> > <typeStr>Replicate</typeStr> > <transport>0</transport> > <xlators/> > <bricks> > <brick uuid="60c37b3c-4941-4d65-bbb5-b202132cdb49">10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick<name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick</name><hostUuid>60c37b3c-4941-4d65-bbb5-b202132cdb49</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da">10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick<name>10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick</name><hostUuid>32f2b0d7-37b5-45d2-ab76-d6109ac1a5da</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65">10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick<name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick</name><hostUuid>3ec7eb35-829e-4d15-887c-ead4e78c2f65</hostUuid><isArbiter>0</isArbiter></brick> > </bricks> > <optCount>3</optCount> > <options> > <option> > <name>transport.address-family</name> > <value>inet</value> > </option> > <option> > <name>nfs.disable</name> > <value>on</value> > </option> > <option> > <name>cluster.brick-multiplex</name> > <value>on</value> > </option> > </options> > </volume> > <count>1</count> > </volumes> > </volInfo> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:29:54 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:271: {OpRet:0 OpErrno:0 OpErrStr: VolInfo:{XMLName:{Space: Local:volInfo} Volumes:{XMLName:{Space: Local:volumes} Count:1 VolumeList:[{XMLName:{Space: Local:volume} VolumeName:vol_3d8325d2095c5196c321cddfd7e3eaea ID:fef78401-f4a3-4daf-b0aa-ebd056e1fb7a Status:1 StatusStr:Started BrickCount:3 DistCount:3 StripeCount:1 ReplicaCount:3 ArbiterCount:0 DisperseCount:0 RedundancyCount:0 Type:2 TypeStr:Replicate Transport:0 Bricks:{XMLName:{Space: Local:bricks} BrickList:[{UUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 IsArbiter:0} {UUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da IsArbiter:0} {UUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 IsArbiter:0}]} OptCount:3 Options:{XMLName:{Space: Local:options} OptionList:[{Name:transport.address-family Value:inet} {Name:nfs.disable Value:on} {Name:cluster.brick-multiplex Value:on}]}}]}}} >[kubeexec] DEBUG 2018/05/29 05:29:54 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume heal vol_3d8325d2095c5196c321cddfd7e3eaea info --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <healInfo> > <bricks> > <brick hostUuid="60c37b3c-4941-4d65-bbb5-b202132cdb49"> > <name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da"> > <name>10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65"> > <name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > </bricks> > </healInfo> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:29:54 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:319: {OpRet:0 OpErrno:0 OpErrStr: HealInfo:{XMLName:{Space: Local:healInfo} Bricks:{BrickList:[{HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_4f96665a9d143e46fa69b9f56ec9d1e4/brick Status:Connected NumberOfEntries:0} {HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick Status:Connected NumberOfEntries:0} {HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_4f14ad754a1bc2d2b686532e12bd7a1e/brick Status:Connected NumberOfEntries:0}]}}} >[heketi] INFO 2018/05/29 05:29:54 Creating brick 2aa308032dc6931168db5393f77a8fe8 >[kubeexec] DEBUG 2018/05/29 05:29:54 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8 >Result: >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 104.472µs >[kubeexec] DEBUG 2018/05/29 05:29:55 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_6d499c3d339689185794d4e0859898a0/tp_2aa308032dc6931168db5393f77a8fe8 -V 1048576K -n brick_2aa308032dc6931168db5393f77a8fe8 >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_2aa308032dc6931168db5393f77a8fe8" created. >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 69.742µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 72.622µs >[kubeexec] DEBUG 2018/05/29 05:29:57 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_2aa308032dc6931168db5393f77a8fe8 >Result: meta-data=/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_2aa308032dc6931168db5393f77a8fe8 isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:29:57 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_2aa308032dc6931168db5393f77a8fe8 /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8 xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:29:57 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_2aa308032dc6931168db5393f77a8fe8 /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8 >Result: >[kubeexec] DEBUG 2018/05/29 05:29:57 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8/brick >Result: >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 65.264µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 58.108µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 69.688µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 71.461µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 111.823µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 72.601µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 147.789µs >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 60.912µs >[heketi] INFO 2018/05/29 05:30:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:30:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:30:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:30:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:30:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 64.308µs >[kubeexec] DEBUG 2018/05/29 05:30:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume replace-brick vol_3d8325d2095c5196c321cddfd7e3eaea 10.70.46.85:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick 10.70.46.85:/var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8/brick commit force >Result: volume replace-brick: success: replace-brick commit force operation successful >[heketi] INFO 2018/05/29 05:30:06 Deleting brick 29b3531a9e56da0b2d88028ea4286b28 >[kubeexec] DEBUG 2018/05/29 05:30:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ21001 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da > ââ21002 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:30:06 Periodic health check status: node e3e6b22f48dd409750f46de51accb317 up=true >[cmdexec] INFO 2018/05/29 05:30:06 Check Glusterd service status in node dhcp46-238.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:30:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Tue 2018-05-29 04:59:09 UTC; 30min ago > Process: 596 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 598 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode166fcde_62fc_11e8_97fc_005056a5c5c6.slice/docker-0744f7595cb61d13b01acb35f637d62f3d5ca9af4ce4d310db2cc3eddbc55b0b.scope/system.slice/glusterd.service > ââ 598 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 892 /usr/sbin/glusterfsd -s 10.70.46.238 --volfile-id heketidbstorage.10.70.46.238.var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.238-var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.pid -S /var/run/gluster/004e46fca39abec8045de043932b7077.socket --brick-name /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_456a280ec02d926fc470e6db5c895737-brick_f02ab5738a7b55c4c4d4d0d857c00681-brick.log --xlator-option *-posix.glusterd-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ2581 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 > ââ2582 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/c843e61b322c4c4a6879d6d26bea010b.socket --xlator-option *replicate*.node-uuid=3ec7eb35-829e-4d15-887c-ead4e78c2f65 >May 29 04:59:06 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 29 04:59:09 dhcp46-238.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:30:06 Periodic health check status: node fa2e86a1d3e5c918018753eb154248a2 up=true >[heketi] INFO 2018/05/29 05:30:06 Cleaned 0 nodes from health cache >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 38.234µs >[kubeexec] DEBUG 2018/05/29 05:30:06 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: umount /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28 >Result: >[kubeexec] DEBUG 2018/05/29 05:30:07 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvremove -f vg_5992fad049cde25f1eb1aab0c0cdee9a/tp_29b3531a9e56da0b2d88028ea4286b28 >Result: Logical volume "brick_29b3531a9e56da0b2d88028ea4286b28" successfully removed > Logical volume "tp_29b3531a9e56da0b2d88028ea4286b28" successfully removed >[kubeexec] DEBUG 2018/05/29 05:30:07 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28 >Result: >[kubeexec] DEBUG 2018/05/29 05:30:07 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_29b3531a9e56da0b2d88028ea4286b28/d" /var/lib/heketi/fstab >Result: >[heketi] INFO 2018/05/29 05:30:07 replaced brick:29b3531a9e56da0b2d88028ea4286b28 on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_29b3531a9e56da0b2d88028ea4286b28/brick with brick:2aa308032dc6931168db5393f77a8fe8 on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_2aa308032dc6931168db5393f77a8fe8/brick >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 200 OK in 62.202µs >[asynchttp] INFO 2018/05/29 05:30:07 asynchttp.go:129: Completed job e7c165268a7f2d0b578647234fdd3d35 in 28.071261886s >[negroni] Started GET /queue/e7c165268a7f2d0b578647234fdd3d35 >[negroni] Completed 204 No Content in 61.055µs >[negroni] Started DELETE /devices/5992fad049cde25f1eb1aab0c0cdee9a >[heketi] INFO 2018/05/29 05:30:08 Deleting device 5992fad049cde25f1eb1aab0c0cdee9a on node e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 202 Accepted in 598.022µs >[asynchttp] INFO 2018/05/29 05:30:08 asynchttp.go:125: Started job 71627180a33a62e0330a59b9babc23a3 >[negroni] Started GET /queue/71627180a33a62e0330a59b9babc23a3 >[negroni] Completed 200 OK in 32.75µs >[kubeexec] DEBUG 2018/05/29 05:30:09 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: vgremove vg_5992fad049cde25f1eb1aab0c0cdee9a >Result: Volume group "vg_5992fad049cde25f1eb1aab0c0cdee9a" successfully removed >[kubeexec] DEBUG 2018/05/29 05:30:09 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: pvremove '/dev/sde' >Result: Labels on physical volume "/dev/sde" successfully wiped. >[kubeexec] DEBUG 2018/05/29 05:30:09 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: ls /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a >Result: >[kubeexec] DEBUG 2018/05/29 05:30:09 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a >Result: >[heketi] INFO 2018/05/29 05:30:09 Deleted node [5992fad049cde25f1eb1aab0c0cdee9a] >[asynchttp] INFO 2018/05/29 05:30:09 asynchttp.go:129: Completed job 71627180a33a62e0330a59b9babc23a3 in 735.156076ms >[negroni] Started GET /queue/71627180a33a62e0330a59b9babc23a3 >[negroni] Completed 204 No Content in 69.865µs >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 82.509µs >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 208.131µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 463.651µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 471.672µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 440.56µs >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 417.587µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 432.796µs >[negroni] Started POST /volumes >[heketi] INFO 2018/05/29 05:30:10 Loaded simple allocator >[heketi] INFO 2018/05/29 05:30:10 brick_num: 0 >[negroni] Completed 202 Accepted in 87.229319ms >[asynchttp] INFO 2018/05/29 05:30:10 asynchttp.go:125: Started job bffc28b5b7f61dceaccd360dad94411f >[heketi] INFO 2018/05/29 05:30:10 Started async operation: Create Volume >[heketi] INFO 2018/05/29 05:30:10 Creating brick 0c69ece1e17e280d8bd8ddb5849c63ac >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 36.944µs >[heketi] INFO 2018/05/29 05:30:10 Creating brick 2ef34ebd98e8c881d4caab680c3198fe >[heketi] INFO 2018/05/29 05:30:10 Creating brick 081a4f64ebf29f1014ddac6dc290d4d6 >[kubeexec] DEBUG 2018/05/29 05:30:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir -p /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: >[kubeexec] DEBUG 2018/05/29 05:30:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir -p /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe >Result: >[kubeexec] DEBUG 2018/05/29 05:30:10 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: >[kubeexec] DEBUG 2018/05/29 05:30:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_456a280ec02d926fc470e6db5c895737/tp_081a4f64ebf29f1014ddac6dc290d4d6 -V 1048576K -n brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_081a4f64ebf29f1014ddac6dc290d4d6" created. >[kubeexec] DEBUG 2018/05/29 05:30:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_e0ad7d31cffddba562fbaaef16cad6ae/tp_2ef34ebd98e8c881d4caab680c3198fe -V 1048576K -n brick_2ef34ebd98e8c881d4caab680c3198fe >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_2ef34ebd98e8c881d4caab680c3198fe" created. >[kubeexec] DEBUG 2018/05/29 05:30:11 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 8192K -c 256K -L 1048576K -T vg_2df7febc45419bc0275826cca6842e8a/tp_0c69ece1e17e280d8bd8ddb5849c63ac -V 1048576K -n brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_0c69ece1e17e280d8bd8ddb5849c63ac" created. >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 54.045µs >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 64.337µs >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 80.931µs >[kubeexec] DEBUG 2018/05/29 05:30:13 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: meta-data=/dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_081a4f64ebf29f1014ddac6dc290d4d6 isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:30:13 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: meta-data=/dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_0c69ece1e17e280d8bd8ddb5849c63ac isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_e0ad7d31cffddba562fbaaef16cad6ae-brick_2ef34ebd98e8c881d4caab680c3198fe >Result: meta-data=/dev/mapper/vg_e0ad7d31cffddba562fbaaef16cad6ae-brick_2ef34ebd98e8c881d4caab680c3198fe isize=512 agcount=8, agsize=32768 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=262144, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: awk "BEGIN {print \"/dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_081a4f64ebf29f1014ddac6dc290d4d6 /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6 xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_0c69ece1e17e280d8bd8ddb5849c63ac /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: awk "BEGIN {print \"/dev/mapper/vg_e0ad7d31cffddba562fbaaef16cad6ae-brick_2ef34ebd98e8c881d4caab680c3198fe /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 39.963µs >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_456a280ec02d926fc470e6db5c895737-brick_081a4f64ebf29f1014ddac6dc290d4d6 /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_2df7febc45419bc0275826cca6842e8a-brick_0c69ece1e17e280d8bd8ddb5849c63ac /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: mkdir /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac/brick >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_e0ad7d31cffddba562fbaaef16cad6ae-brick_2ef34ebd98e8c881d4caab680c3198fe /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe >Result: >[kubeexec] DEBUG 2018/05/29 05:30:14 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: mkdir /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe/brick >Result: >[cmdexec] INFO 2018/05/29 05:30:14 Creating volume vol_260ed8882e97413f9aef95dbcd772ed1 replica 3 >[kubeexec] DEBUG 2018/05/29 05:30:15 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume create vol_260ed8882e97413f9aef95dbcd772ed1 replica 3 10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac/brick 10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6/brick 10.70.47.38:/var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe/brick >Result: volume create: vol_260ed8882e97413f9aef95dbcd772ed1: success: please start the volume to access data >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 34.925µs >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 53.693µs >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 200 OK in 61.154µs >[kubeexec] DEBUG 2018/05/29 05:30:17 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume start vol_260ed8882e97413f9aef95dbcd772ed1 >Result: volume start: vol_260ed8882e97413f9aef95dbcd772ed1: success >[heketi] INFO 2018/05/29 05:30:17 Create Volume succeeded >[asynchttp] INFO 2018/05/29 05:30:17 asynchttp.go:129: Completed job bffc28b5b7f61dceaccd360dad94411f in 7.707718997s >[negroni] Started GET /queue/bffc28b5b7f61dceaccd360dad94411f >[negroni] Completed 303 See Other in 68.241µs >[negroni] Started GET /volumes/260ed8882e97413f9aef95dbcd772ed1 >[negroni] Completed 200 OK in 718.179µs >[negroni] Started DELETE /volumes/260ed8882e97413f9aef95dbcd772ed1 >[heketi] INFO 2018/05/29 05:30:18 Loaded simple allocator >[negroni] Completed 202 Accepted in 120.045524ms >[asynchttp] INFO 2018/05/29 05:30:18 asynchttp.go:125: Started job 514fd6fc42a9ffc4f7583b9d3a3ab9fa >[heketi] INFO 2018/05/29 05:30:18 Started async operation: Delete Volume >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 30.774µs >[kubeexec] DEBUG 2018/05/29 05:30:18 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script snapshot list vol_260ed8882e97413f9aef95dbcd772ed1 --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <snapList> > <count>0</count> > </snapList> ></cliOutput> >[kubeexec] DEBUG 2018/05/29 05:30:18 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_210971d929f335f169e239d17cc4a12a: > brick_4f96665a9d143e46fa69b9f56ec9d1e4: > tp_210971d929f335f169e239d17cc4a12a:1 > tp_4f96665a9d143e46fa69b9f56ec9d1e4:1 > brick_2ef34ebd98e8c881d4caab680c3198fe: > tp_2ef34ebd98e8c881d4caab680c3198fe:1 >[kubeexec] DEBUG 2018/05/29 05:30:18 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_0c69ece1e17e280d8bd8ddb5849c63ac: > brick_f5e7b6b97f11333944a5806ffef27659: > tp_0c69ece1e17e280d8bd8ddb5849c63ac:1 > tp_f5e7b6b97f11333944a5806ffef27659:1 > brick_2aa308032dc6931168db5393f77a8fe8: > tp_2aa308032dc6931168db5393f77a8fe8:1 >[kubeexec] DEBUG 2018/05/29 05:30:18 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvs --options=lv_name,thin_count --separator=: >Result: LV:#Thins > home: > root: > swap: > var: > var: > brick_081a4f64ebf29f1014ddac6dc290d4d6: > brick_4f14ad754a1bc2d2b686532e12bd7a1e: > brick_f02ab5738a7b55c4c4d4d0d857c00681: > tp_081a4f64ebf29f1014ddac6dc290d4d6:1 > tp_4f14ad754a1bc2d2b686532e12bd7a1e:1 > tp_f02ab5738a7b55c4c4d4d0d857c00681:1 >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 54.545µs >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 40.94µs >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 73.924µs >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 50.303µs >[kubeexec] DEBUG 2018/05/29 05:30:22 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script volume stop vol_260ed8882e97413f9aef95dbcd772ed1 force >Result: volume stop: vol_260ed8882e97413f9aef95dbcd772ed1: success >[kubeexec] DEBUG 2018/05/29 05:30:22 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: gluster --mode=script volume delete vol_260ed8882e97413f9aef95dbcd772ed1 >Result: volume delete: vol_260ed8882e97413f9aef95dbcd772ed1: success >[heketi] INFO 2018/05/29 05:30:22 Deleting brick 081a4f64ebf29f1014ddac6dc290d4d6 >[heketi] INFO 2018/05/29 05:30:22 Deleting brick 0c69ece1e17e280d8bd8ddb5849c63ac >[heketi] INFO 2018/05/29 05:30:22 Deleting brick 2ef34ebd98e8c881d4caab680c3198fe >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: umount /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe >Result: >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: umount /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: umount /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 67.421µs >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: lvremove -f vg_e0ad7d31cffddba562fbaaef16cad6ae/tp_2ef34ebd98e8c881d4caab680c3198fe >Result: Logical volume "brick_2ef34ebd98e8c881d4caab680c3198fe" successfully removed > Logical volume "tp_2ef34ebd98e8c881d4caab680c3198fe" successfully removed >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvremove -f vg_2df7febc45419bc0275826cca6842e8a/tp_0c69ece1e17e280d8bd8ddb5849c63ac >Result: Logical volume "brick_0c69ece1e17e280d8bd8ddb5849c63ac" successfully removed > Logical volume "tp_0c69ece1e17e280d8bd8ddb5849c63ac" successfully removed >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: rmdir /var/lib/heketi/mounts/vg_e0ad7d31cffddba562fbaaef16cad6ae/brick_2ef34ebd98e8c881d4caab680c3198fe >Result: >[kubeexec] DEBUG 2018/05/29 05:30:23 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: lvremove -f vg_456a280ec02d926fc470e6db5c895737/tp_081a4f64ebf29f1014ddac6dc290d4d6 >Result: Logical volume "brick_081a4f64ebf29f1014ddac6dc290d4d6" successfully removed > Logical volume "tp_081a4f64ebf29f1014ddac6dc290d4d6" successfully removed >[kubeexec] DEBUG 2018/05/29 05:30:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: rmdir /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_0c69ece1e17e280d8bd8ddb5849c63ac >Result: >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 68.055µs >[kubeexec] DEBUG 2018/05/29 05:30:24 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: sed -i.save "/brick_2ef34ebd98e8c881d4caab680c3198fe/d" /var/lib/heketi/fstab >Result: >[kubeexec] DEBUG 2018/05/29 05:30:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: rmdir /var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_081a4f64ebf29f1014ddac6dc290d4d6 >Result: >[kubeexec] DEBUG 2018/05/29 05:30:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_0c69ece1e17e280d8bd8ddb5849c63ac/d" /var/lib/heketi/fstab >Result: >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 200 OK in 50.058µs >[kubeexec] DEBUG 2018/05/29 05:30:25 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-238.lab.eng.blr.redhat.com Pod: glusterfs-0n776 Command: sed -i.save "/brick_081a4f64ebf29f1014ddac6dc290d4d6/d" /var/lib/heketi/fstab >Result: >[heketi] INFO 2018/05/29 05:30:25 Delete Volume succeeded >[asynchttp] INFO 2018/05/29 05:30:25 asynchttp.go:129: Completed job 514fd6fc42a9ffc4f7583b9d3a3ab9fa in 7.262437426s >[negroni] Started GET /queue/514fd6fc42a9ffc4f7583b9d3a3ab9fa >[negroni] Completed 204 No Content in 55.272µs >[negroni] Started POST /devices/2df7febc45419bc0275826cca6842e8a/state >[negroni] Completed 202 Accepted in 671.219µs >[asynchttp] INFO 2018/05/29 05:30:26 asynchttp.go:125: Started job 5d721cdde81f117858dd837a66693bb3 >[heketi] INFO 2018/05/29 05:30:26 Loaded simple allocator >[negroni] Started GET /queue/5d721cdde81f117858dd837a66693bb3 >[negroni] Completed 200 OK in 66.932µs >[asynchttp] INFO 2018/05/29 05:30:26 asynchttp.go:129: Completed job 5d721cdde81f117858dd837a66693bb3 in 111.725025ms >[negroni] Started GET /queue/5d721cdde81f117858dd837a66693bb3 >[negroni] Completed 204 No Content in 51.107µs >[negroni] Started POST /devices/2df7febc45419bc0275826cca6842e8a/state >[negroni] Completed 202 Accepted in 312.009µs >[asynchttp] INFO 2018/05/29 05:30:27 asynchttp.go:125: Started job 8cd3414687b70e99be2b9ffb402c878a >[heketi] INFO 2018/05/29 05:30:27 Loaded simple allocator >[heketi] INFO 2018/05/29 05:30:27 Running Remove Device >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 20.161µs >[heketi] INFO 2018/05/29 05:30:27 Replacing brick f5e7b6b97f11333944a5806ffef27659 on device 2df7febc45419bc0275826cca6842e8a on node e3e6b22f48dd409750f46de51accb317 >[cmdexec] INFO 2018/05/29 05:30:27 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 455 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 456 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abffb5d_629b_11e8_97fc_005056a5c5c6.slice/docker-d2429e3d162ac404f6c11f82ad523d4b4df29fc37b9893117d2213d2bae57b3c.scope/system.slice/glusterd.service > ââ 456 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1130 /usr/sbin/glusterfsd -s 10.70.46.85 --volfile-id heketidbstorage.10.70.46.85.var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick -p /var/run/gluster/vols/heketidbstorage/10.70.46.85-var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.pid -S /var/run/gluster/fbacb99fb11ac273ded73a7202dfd3ce.socket --brick-name /var/lib/heketi/mounts/vg_5992fad049cde25f1eb1aab0c0cdee9a/brick_158723f37f7f135acca3015abe2454fb/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_5992fad049cde25f1eb1aab0c0cdee9a-brick_158723f37f7f135acca3015abe2454fb-brick.log --xlator-option *-posix.glusterd-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ21262 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/2def6d0e0bf1948845b3ef69cb85a63a.socket --xlator-option *replicate*.node-uuid=32f2b0d7-37b5-45d2-ab76-d6109ac1a5da >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service: main process exited, code=exited, status=15/n/a >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Unit glusterd.service entered failed state. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: glusterd.service failed. >May 28 17:20:25 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp46-85.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[kubeexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume info heketidbstorage --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> > <volInfo> > <volumes> > <volume> > <name>heketidbstorage</name> > <id>ea656013-270f-49c3-b9c9-5923e8e25dfa</id> > <status>1</status> > <statusStr>Started</statusStr> > <snapshotCount>0</snapshotCount> > <brickCount>3</brickCount> > <distCount>3</distCount> > <stripeCount>1</stripeCount> > <replicaCount>3</replicaCount> > <arbiterCount>0</arbiterCount> > <disperseCount>0</disperseCount> > <redundancyCount>0</redundancyCount> > <type>2</type> > <typeStr>Replicate</typeStr> > <transport>0</transport> > <xlators/> > <bricks> > <brick uuid="60c37b3c-4941-4d65-bbb5-b202132cdb49">10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick<name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick</name><hostUuid>60c37b3c-4941-4d65-bbb5-b202132cdb49</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da">10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick<name>10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick</name><hostUuid>32f2b0d7-37b5-45d2-ab76-d6109ac1a5da</hostUuid><isArbiter>0</isArbiter></brick> > <brick uuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65">10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick<name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick</name><hostUuid>3ec7eb35-829e-4d15-887c-ead4e78c2f65</hostUuid><isArbiter>0</isArbiter></brick> > </bricks> > <optCount>3</optCount> > <options> > <option> > <name>transport.address-family</name> > <value>inet</value> > </option> > <option> > <name>nfs.disable</name> > <value>on</value> > </option> > <option> > <name>cluster.brick-multiplex</name> > <value>on</value> > </option> > </options> > </volume> > <count>1</count> > </volumes> > </volInfo> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:271: {OpRet:0 OpErrno:0 OpErrStr: VolInfo:{XMLName:{Space: Local:volInfo} Volumes:{XMLName:{Space: Local:volumes} Count:1 VolumeList:[{XMLName:{Space: Local:volume} VolumeName:heketidbstorage ID:ea656013-270f-49c3-b9c9-5923e8e25dfa Status:1 StatusStr:Started BrickCount:3 DistCount:3 StripeCount:1 ReplicaCount:3 ArbiterCount:0 DisperseCount:0 RedundancyCount:0 Type:2 TypeStr:Replicate Transport:0 Bricks:{XMLName:{Space: Local:bricks} BrickList:[{UUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 IsArbiter:0} {UUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da IsArbiter:0} {UUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 IsArbiter:0}]} OptCount:3 Options:{XMLName:{Space: Local:options} OptionList:[{Name:transport.address-family Value:inet} {Name:nfs.disable Value:on} {Name:cluster.brick-multiplex Value:on}]}}]}}} >[kubeexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume heal heketidbstorage info --xml >Result: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> ><cliOutput> > <healInfo> > <bricks> > <brick hostUuid="60c37b3c-4941-4d65-bbb5-b202132cdb49"> > <name>10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="32f2b0d7-37b5-45d2-ab76-d6109ac1a5da"> > <name>10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > <brick hostUuid="3ec7eb35-829e-4d15-887c-ead4e78c2f65"> > <name>10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick</name> > <status>Connected</status> > <numberOfEntries>0</numberOfEntries> > </brick> > </bricks> > </healInfo> > <opRet>0</opRet> > <opErrno>0</opErrno> > <opErrstr/> ></cliOutput> >[cmdexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/cmdexec/volume.go:319: {OpRet:0 OpErrno:0 OpErrStr: HealInfo:{XMLName:{Space: Local:healInfo} Bricks:{BrickList:[{HostUUID:60c37b3c-4941-4d65-bbb5-b202132cdb49 Name:10.70.47.38:/var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick Status:Connected NumberOfEntries:0} {HostUUID:32f2b0d7-37b5-45d2-ab76-d6109ac1a5da Name:10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick Status:Connected NumberOfEntries:0} {HostUUID:3ec7eb35-829e-4d15-887c-ead4e78c2f65 Name:10.70.46.238:/var/lib/heketi/mounts/vg_456a280ec02d926fc470e6db5c895737/brick_f02ab5738a7b55c4c4d4d0d857c00681/brick Status:Connected NumberOfEntries:0}]}}} >[heketi] INFO 2018/05/29 05:30:28 Creating brick 7fa6e112aa4cf0354fd9cf15d00c48fe >[kubeexec] DEBUG 2018/05/29 05:30:28 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir -p /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe >Result: >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 48.761µs >[kubeexec] DEBUG 2018/05/29 05:30:29 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: lvcreate --poolmetadatasize 12288K -c 256K -L 2097152K -T vg_6d499c3d339689185794d4e0859898a0/tp_7fa6e112aa4cf0354fd9cf15d00c48fe -V 2097152K -n brick_7fa6e112aa4cf0354fd9cf15d00c48fe >Result: Thin pool volume with chunk size 256.00 KiB can address at most 63.25 TiB of data. > Logical volume "brick_7fa6e112aa4cf0354fd9cf15d00c48fe" created. >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 62.038µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 79.121µs >[kubeexec] DEBUG 2018/05/29 05:30:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkfs.xfs -i size=512 -n size=8192 /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_7fa6e112aa4cf0354fd9cf15d00c48fe >Result: meta-data=/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_7fa6e112aa4cf0354fd9cf15d00c48fe isize=512 agcount=8, agsize=65536 blks > = sectsz=512 attr=2, projid32bit=1 > = crc=1 finobt=0, sparse=0 >data = bsize=4096 blocks=524288, imaxpct=25 > = sunit=64 swidth=64 blks >naming =version 2 bsize=8192 ascii-ci=0 ftype=1 >log =internal log bsize=4096 blocks=2560, version=2 > = sectsz=512 sunit=64 blks, lazy-count=1 >realtime =none extsz=4096 blocks=0, rtextents=0 >[kubeexec] DEBUG 2018/05/29 05:30:30 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: awk "BEGIN {print \"/dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_7fa6e112aa4cf0354fd9cf15d00c48fe /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe xfs rw,inode64,noatime,nouuid 1 2\" >> \"/var/lib/heketi/fstab\"}" >Result: >[kubeexec] DEBUG 2018/05/29 05:30:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mount -o rw,inode64,noatime,nouuid /dev/mapper/vg_6d499c3d339689185794d4e0859898a0-brick_7fa6e112aa4cf0354fd9cf15d00c48fe /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe >Result: >[kubeexec] DEBUG 2018/05/29 05:30:31 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: mkdir /var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe/brick >Result: >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 54.083µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 75.638µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 82.394µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 86.604µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 73.665µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 69.575µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 137.835µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 46.255µs >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 83.725µs >[kubeexec] DEBUG 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: gluster --mode=script volume replace-brick heketidbstorage 10.70.46.85:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick 10.70.46.85:/var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe/brick commit force >Result: volume replace-brick: success: replace-brick commit force operation successful >[heketi] INFO 2018/05/29 05:30:40 Deleting brick f5e7b6b97f11333944a5806ffef27659 >[kubeexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:240: Failed to run command [umount /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659] on glusterfs-fx8x7: Err[command terminated with exit code 32]: Stdout []: Stderr [umount: /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659: target is busy. > (In some cases useful info about processes that use > the device is found by lsof(8) or fuser(1)) >] >[cmdexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/cmdexec/brick.go:123: Unable to execute command on glusterfs-fx8x7: umount: /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659: target is busy. > (In some cases useful info about processes that use > the device is found by lsof(8) or fuser(1)) >[kubeexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:240: Failed to run command [lvremove -f vg_2df7febc45419bc0275826cca6842e8a/tp_f5e7b6b97f11333944a5806ffef27659] on glusterfs-fx8x7: Err[command terminated with exit code 5]: Stdout []: Stderr [ Logical volume vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659 contains a filesystem in use. >] >[cmdexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/cmdexec/brick.go:132: Unable to execute command on glusterfs-fx8x7: Logical volume vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659 contains a filesystem in use. >[kubeexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:240: Failed to run command [rmdir /var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659] on glusterfs-fx8x7: Err[command terminated with exit code 1]: Stdout []: Stderr [rmdir: failed to remove '/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659': Device or resource busy >] >[cmdexec] ERROR 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/cmdexec/brick.go:141: Unable to execute command on glusterfs-fx8x7: rmdir: failed to remove '/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659': Device or resource busy >[kubeexec] DEBUG 2018/05/29 05:30:40 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp46-85.lab.eng.blr.redhat.com Pod: glusterfs-fx8x7 Command: sed -i.save "/brick_f5e7b6b97f11333944a5806ffef27659/d" /var/lib/heketi/fstab >Result: >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 200 OK in 60.581µs >[heketi] INFO 2018/05/29 05:30:40 replaced brick:f5e7b6b97f11333944a5806ffef27659 on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_2df7febc45419bc0275826cca6842e8a/brick_f5e7b6b97f11333944a5806ffef27659/brick with brick:7fa6e112aa4cf0354fd9cf15d00c48fe on node:e3e6b22f48dd409750f46de51accb317 at path:/var/lib/heketi/mounts/vg_6d499c3d339689185794d4e0859898a0/brick_7fa6e112aa4cf0354fd9cf15d00c48fe/brick >[asynchttp] INFO 2018/05/29 05:30:40 asynchttp.go:129: Completed job 8cd3414687b70e99be2b9ffb402c878a in 13.222093873s >[negroni] Started GET /queue/8cd3414687b70e99be2b9ffb402c878a >[negroni] Completed 204 No Content in 72.517µs >[negroni] Started DELETE /devices/2df7febc45419bc0275826cca6842e8a >[heketi] INFO 2018/05/29 05:30:41 Deleting device 2df7febc45419bc0275826cca6842e8a on node e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 202 Accepted in 579.26µs >[asynchttp] INFO 2018/05/29 05:30:41 asynchttp.go:125: Started job addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.961µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 42.789µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.581µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.158µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 160.52µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.958µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.551µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.714µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.631µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.164µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.955µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.464µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.944µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.996µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.948µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.838µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.661µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.411µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.511µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.278µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.554µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.091µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.777µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.061µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.364µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.788µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.658µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.211µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.901µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.438µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.344µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.914µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.761µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.381µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 128.252µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.357µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.164µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.674µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.114µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.751µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.847µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.141µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.014µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.435µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.601µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.838µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.917µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.878µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.368µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.931µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.804µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.111µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.528µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.575µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.954µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.928µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.444µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.391µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.888µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.793µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.941µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.144µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 105.467µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.527µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.691µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.091µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.83µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.545µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.708µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.646µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.905µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.221µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.778µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.697µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.734µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.614µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.774µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.107µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 125.794µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.368µs >[heketi] INFO 2018/05/29 05:32:04 Starting Node Health Status refresh >[cmdexec] INFO 2018/05/29 05:32:04 Check Glusterd service status in node dhcp47-38.lab.eng.blr.redhat.com >[kubeexec] DEBUG 2018/05/29 05:32:05 /src/github.com/heketi/heketi/executors/kubeexec/kubeexec.go:244: Host: dhcp47-38.lab.eng.blr.redhat.com Pod: glusterfs-rfg21 Command: systemctl status glusterd >Result: â glusterd.service - GlusterFS, a clustered file-system server > Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled) > Active: active (running) since Mon 2018-05-28 17:20:29 UTC; 12h ago > Process: 454 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS) > Main PID: 455 (glusterd) > CGroup: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abff0f1_629b_11e8_97fc_005056a5c5c6.slice/docker-759b321b7809140c4239d19342fa1715a49dc819bb3a837dc7b1d6482d82ca3f.scope/system.slice/glusterd.service > ââ 455 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO > ââ 1233 /usr/sbin/glusterfsd -s 10.70.47.38 --volfile-id heketidbstorage.10.70.47.38.var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick -p /var/run/gluster/vols/heketidbstorage/10.70.47.38-var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.pid -S /var/run/gluster/87ff1e465b12abed15cd3563fbb53077.socket --brick-name /var/lib/heketi/mounts/vg_44ef3a02b018b9f8855bdb487bda910f/brick_210971d929f335f169e239d17cc4a12a/brick -l /var/log/glusterfs/bricks/var-lib-heketi-mounts-vg_44ef3a02b018b9f8855bdb487bda910f-brick_210971d929f335f169e239d17cc4a12a-brick.log --xlator-option *-posix.glusterd-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 --brick-port 49152 --xlator-option heketidbstorage-server.listen-port=49152 > ââ19192 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/gluster/a83d42c57733f8bee33769ba66aa6069.socket --xlator-option *replicate*.node-uuid=60c37b3c-4941-4d65-bbb5-b202132cdb49 >May 28 17:20:26 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Starting GlusterFS, a clustered file-system server... >May 28 17:20:29 dhcp47-38.lab.eng.blr.redhat.com systemd[1]: Started GlusterFS, a clustered file-system server. >[heketi] INFO 2018/05/29 05:32:05 Periodic health check status: node 866bea732a8fead87ff6b1720301a3b6 up=true >[cmdexec] INFO 2018/05/29 05:32:05 Check Glusterd service status in node dhcp46-85.lab.eng.blr.redhat.com >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.341µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.043µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.757µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.339µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.36µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.873µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.061µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.478µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.61µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.724µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 160.494µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.708µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.15µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.493µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.994µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.367µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.557µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.114µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.891µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.395µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.351µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.714µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.234µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.316µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.44µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.068µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.611µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.524µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.564µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.237µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.97µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.764µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.778µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.325µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.616µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.554µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.807µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.294µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.393µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.674µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.922µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.637µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.384µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.531µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.344µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.549µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.931µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.936µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.533µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.663µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.168µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.964µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.863µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.361µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.813µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.364µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.65µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.751µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.167µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 123.687µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.186µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.668µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.808µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.231µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.271µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.955µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.863µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.958µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.264µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.354µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.457µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.628µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 101.594µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.618µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.78µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.256µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.02µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.36µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.01µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.641µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.118µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.774µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.44µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.047µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.983µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.765µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.194µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.646µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.541µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.781µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.396µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.931µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.807µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.264µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.554µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.381µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.045µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.6µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.627µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.631µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.744µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.973µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.597µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.14µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.316µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.802µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.48µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.703µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.853µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 134.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 139.121µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.45µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.036µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.046µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.093µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.794µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.584µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.143µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.79µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.971µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.484µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.753µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.096µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.174µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.864µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.544µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.352µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.941µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.033µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.323µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.414µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.114µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.933µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.574µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.847µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.343µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.11µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.6µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.87µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.963µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.063µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.268µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.07µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.647µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.277µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.518µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.19µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.337µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.546µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.033µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.857µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.224µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.126µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.27µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.484µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.717µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.514µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.641µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.52µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.503µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.796µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.13µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.431µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.735µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.386µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.033µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.882µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.746µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.337µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.47µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.066µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.227µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.127µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.01µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.531µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.294µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.181µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.67µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.627µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.774µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.763µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.423µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.49µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.356µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.016µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.697µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 99.767µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.623µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.03µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.28µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.767µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.9µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 102.426µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.503µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.48µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.226µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.566µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.562µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.429µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.48µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.227µs >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 136.563µs >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 231.492µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 1.1049ms >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 512.867µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 461.099µs >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 465.889µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 461.804µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.23µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.758µs >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 142.376µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 639.611µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 825.863µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.104µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.764µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.524µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.417µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.99µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.69µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.18µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.09µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.31µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.676µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 121.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.506µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.874µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.95µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.917µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.257µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.663µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.947µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.207µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.82µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.567µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.32µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.713µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.164µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.263µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.347µs >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 155.69µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 997.549µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 911.709µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.617µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.164µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.873µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.061µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.127µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.577µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.303µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.73µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.873µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.463µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.156µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.57µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.65µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.88µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.507µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.567µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.426µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.683µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.25µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.718µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.157µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.083µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 119.569µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 34.084µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.465µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 41.397µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.009µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.237µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.884µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.25µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.303µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.256µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.853µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.504µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.587µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.72µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.653µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.724µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.986µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.933µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.183µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.836µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.019µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.45µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.226µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.07µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.283µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.41µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.123µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.812µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.769µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 121.166µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.079µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.925µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.7µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.573µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.043µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.97µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.699µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.062µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.68µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.876µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.963µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.74µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.292µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.805µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.346µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.154µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.803µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.51µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.303µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.876µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.296µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.857µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.949µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.606µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.136µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.7µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.719µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.64µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.147µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.132µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.799µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.11µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.446µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.979µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.196µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.146µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.857µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.349µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.157µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.806µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.863µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.103µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 101.599µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.622µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.773µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.77µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.559µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.52µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.526µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.076µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.284µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.787µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.236µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.104µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.263µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.33µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.513µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.79µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.664µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.667µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.239µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.162µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.096µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.598µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.749µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 46.137µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.814µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.697µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.549µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.208µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.306µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.77µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.962µs >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 121.578µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 683.315µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 524.85µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 112.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.593µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.572µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.808µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.079µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.662µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.113µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.902µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.74µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.375µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.446µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.686µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 46.518µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.782µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.43µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.963µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.436µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.289µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.977µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.259µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.119µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 37.689µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.25µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.64µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.012µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.32µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 102.279µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.367µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.948µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.035µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.335µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.586µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.259µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 113.723µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.42µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.715µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.476µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.057µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.253µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.025µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 129.206µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.009µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.264µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.707µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.712µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.47µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.349µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.332µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 124.805µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.326µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.295µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.916µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.37µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.577µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.079µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.243µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.326µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.63µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.355µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.149µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.444µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 102.869µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.7µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.702µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 106.646µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.802µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.646µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 128.019µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 133.196µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.776µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 147.039µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.635µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.736µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.47µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.386µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.005µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.846µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.432µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.207µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.516µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.075µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.222µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.365µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.397µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.289µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.805µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.669µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.152µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.431µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.64µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.514µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.97µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.443µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.623µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.173µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.773µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.679µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.515µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 96.499µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.126µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.395µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.019µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.599µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.336µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 96.126µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.437µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.319µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 113.559µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.608µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.429µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.797µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.006µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.243µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.54µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.605µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.959µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.539µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.264µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.506µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.409µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.02µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.9µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.346µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.306µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.704µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.265µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.353µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 121.691µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.083µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.932µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.83µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.085µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.509µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.284µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.389µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.775µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.516µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.345µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.667µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.106µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.986µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.323µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.753µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.889µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.579µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.803µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.992µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.636µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.795µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.425µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.192µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.313µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.706µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.499µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.954µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.476µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.135µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.449µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.432µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.525µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.859µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.926µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.422µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 129.879µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.675µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.61µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.069µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.42µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.745µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.544µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 146.239µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.29µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.476µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.106µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.13µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.482µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.145µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.382µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.562µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 46.66µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.112µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.916µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.089µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.139µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.283µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.859µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.919µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.573µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.869µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.725µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.96µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.822µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.109µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.159µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 129.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.421µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 99.593µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.276µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.605µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.259µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.745µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.406µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.699µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.359µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.163µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.285µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.692µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.162µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.685µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.445µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.326µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.389µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.049µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.799µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.016µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.03µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.892µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.029µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.066µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.403µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.046µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.176µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.922µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.806µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.032µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.049µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.309µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.839µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.722µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.286µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.183µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.439µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.488µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.295µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.373µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.042µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.355µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.706µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.585µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.792µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.242µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.919µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 123.825µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.632µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.709µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.049µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.279µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.189µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.562µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.699µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.066µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.376µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.772µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.776µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.373µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.609µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.536µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.963µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.333µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.262µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.782µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.043µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.056µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.322µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.309µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.609µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.932µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.709µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.269µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.015µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.43µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.849µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.888µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.745µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.45µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.099µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.565µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.668µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.613µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.574µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.801µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.554µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.13µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.655µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.822µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.169µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 125.005µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.229µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.862µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.507µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.435µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 105.949µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.089µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.069µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.753µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.649µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.012µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.493µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.885µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.763µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.729µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.66µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.086µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.439µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.943µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.243µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.159µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.165µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.315µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.197µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.594µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.032µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.408µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.762µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.296µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.179µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.006µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.063µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.009µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.843µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.296µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.789µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.342µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.666µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.376µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.849µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.118µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.722µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.489µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.641µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.27µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.779µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.993µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.563µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.632µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.775µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.189µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.649µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.096µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.123µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.97µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 124.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.493µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.497µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.932µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.874µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.369µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.501µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.98µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.956µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.669µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.652µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.221µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 106.167µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.346µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.558µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.713µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.746µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.95µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.33µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.946µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.423µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.907µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.46µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.586µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.056µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.95µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.683µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.149µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.1µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.474µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.273µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.973µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.324µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.477µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.956µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.517µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.662µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.814µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.727µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.844µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.864µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.893µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.482µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.773µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.61µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.42µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.04µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.656µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.29µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.248µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.997µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 101.507µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.277µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.9µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.712µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.845µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.173µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.666µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.246µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.443µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.699µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 129.246µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.337µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.083µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.73µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.569µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.303µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.056µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.339µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.905µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.659µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.313µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.434µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.902µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 132.58µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.836µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.882µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 161.276µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.734µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.302µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.487µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.702µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.919µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.514µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.54µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 146.986µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.197µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.072µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.563µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.983µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 106.314µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.85µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.38µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.376µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.96µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.244µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.09µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.776µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.166µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.819µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.046µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.563µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.326µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.743µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.276µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.95µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.167µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.657µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 40.568µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.622µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.232µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.196µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.14µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.987µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.933µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.365µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.756µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.96µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.272µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.129µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.15µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.383µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.603µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.16µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.15µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.983µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 112.273µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.545µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.953µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.713µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.867µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.277µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.1µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.639µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 42.915µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.1µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.432µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.953µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.952µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.067µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.64µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.13µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.949µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.103µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 124.616µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.05µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.69µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.509µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.047µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.08µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.35µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.845µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.024µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.665µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.076µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.978µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.714µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.079µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.536µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.449µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.334µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.273µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.873µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.399µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.18µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.453µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.021µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.338µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.264µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.409µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.112µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.579µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.439µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.386µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.809µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.182µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.433µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.166µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.82µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.27µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.477µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.674µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.055µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.04µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.297µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.007µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.327µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.197µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.486µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.553µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.472µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.11µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.883µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.78µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 113.719µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 148.979µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.197µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.73µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.77µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.827µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.4µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.529µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.953µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.224µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.766µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.536µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.384µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.44µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.622µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.934µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.066µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.901µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.214µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.194µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.819µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.52µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.627µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.66µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.555µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.232µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 140.516µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.42µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.26µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.047µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.98µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.17µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 122.546µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.423µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.32µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.596µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.792µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.276µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.107µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.711µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.045µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.52µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.129µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.72µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.163µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.703µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.095µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 123.749µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.463µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 102.709µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.016µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.623µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.333µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.356µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.996µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.105µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.963µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.626µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.097µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.953µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 133.702µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.476µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.956µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.549µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.147µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.309µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.486µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.4µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.75µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 113.746µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.946µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.256µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.413µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.857µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.656µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.776µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.794µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.173µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.782µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.17µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.947µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 145.292µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.867µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.559µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 97.459µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.359µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.349µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.576µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.45µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.038µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.986µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.312µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.779µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.54µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.59µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.143µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.866µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.866µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 107.412µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.762µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.136µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.641µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.24µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.496µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.934µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.26µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.546µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.839µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.3µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.436µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.167µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 125.209µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.752µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.102µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.503µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.302µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.142µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.357µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.869µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.423µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 105.776µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.012µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.762µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.479µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 111.686µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.792µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.712µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.94µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.951µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.397µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 129.998µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.82µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.296µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 122.453µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.085µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.598µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.443µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.303µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.572µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.436µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 97.195µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.374µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.056µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.007µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 201.908µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.943µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.652µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.676µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.197µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.429µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.312µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.573µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.497µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.287µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.423µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.549µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.124µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.489µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 121.362µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.46µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.416µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.899µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.559µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.049µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.005µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.571µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.312µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.952µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.36µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.942µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.743µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.322µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.853µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.496µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.339µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.434µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.059µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.409µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.923µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.373µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.803µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.325µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.62µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.203µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.236µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.119µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.632µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.143µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.235µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.009µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.742µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.173µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.416µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.459µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.56µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.466µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.722µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.503µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.768µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.455µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.959µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.253µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.113µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.701µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.903µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.009µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.734µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.78µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.78µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.659µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.492µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.553µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.502µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.135µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.689µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.697µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.797µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.533µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.899µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.296µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.929µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 96.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.935µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.343µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.33µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.077µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.757µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.23µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.54µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.072µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.309µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 92.912µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.652µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 99.749µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.659µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.779µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.226µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.102µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.244µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.479µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.289µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.59µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.593µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.773µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.132µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.186µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.162µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.667µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.207µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.859µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.736µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.976µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.696µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.852µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.205µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.26µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.384µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.162µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 123.999µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.001µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.905µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.444µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.939µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.287µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.023µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.524µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.525µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.319µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 115.056µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.069µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.897µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.48µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.702µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.837µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.413µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.789µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.572µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.819µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.306µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.547µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.153µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.803µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.626µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.813µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.479µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.16µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.15µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.539µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.677µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.027µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.836µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.763µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.242µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.54µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.236µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.726µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.237µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.601µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.333µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.486µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.289µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.27µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.923µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.646µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.462µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.419µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.792µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.142µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.292µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.529µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.818µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.855µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.39µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.422µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.152µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.787µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.595µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.189µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.216µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.085µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.436µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.83µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.345µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 122.129µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.357µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.473µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.059µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.313µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.829µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.82µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.335µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.097µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.922µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.809µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.893µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.036µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.962µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.46µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.628µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.903µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.079µs >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 167.998µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 1.004458ms >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 573.574µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.982µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.26µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.53µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.525µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.576µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.497µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.179µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.352µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 125.552µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.799µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.595µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.77µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 43.683µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 45.597µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.77µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.306µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.61µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.074µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.936µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.356µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.283µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.856µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.523µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.086µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.116µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.894µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.732µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.356µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.612µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.862µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.831µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.476µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.737µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.31µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.966µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.977µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.01µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.293µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.179µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.626µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.736µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.342µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.576µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.856µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.883µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 101.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.742µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.579µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.727µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.487µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.063µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.336µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 106.496µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.316µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.546µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.581µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.479µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.232µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.276µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.796µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.517µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.752µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 46.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.596µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 44.66µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.119µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.28µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.072µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.299µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.986µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.149µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.297µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.426µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.159µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.796µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.023µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.086µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.152µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.709µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.142µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.408µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 106.516µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.989µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.937µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 43.184µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.353µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.366µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.615µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.076µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.159µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.302µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.369µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.896µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.982µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.275µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.889µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.392µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.63µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.298µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.506µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.744µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.426µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.623µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.784µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.389µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.682µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.7µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.139µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.409µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.843µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.277µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 104.412µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.973µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.243µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.875µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.592µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.619µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.625µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.959µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.382µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.012µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.215µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.799µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.287µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.082µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.519µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.822µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 39.703µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.452µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.733µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.852µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.186µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.579µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.753µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.149µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.716µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.583µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.615µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.636µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.332µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.506µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.659µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.582µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.917µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.599µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.89µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.149µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.466µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.616µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.252µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.304µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.344µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.755µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 136.049µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.492µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.85µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.762µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.468µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.785µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.046µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.403µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.772µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.236µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.126µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.887µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.02µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.417µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.887µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.564µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.81µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.144µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.201µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.545µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.997µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.473µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.024µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.547µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.08µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.586µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.643µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.857µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.706µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.65µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.413µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.455µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.763µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.847µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.804µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.861µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.045µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.103µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.11µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.944µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.3µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.137µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.077µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.836µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.843µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.95µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.317µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.89µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.55µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.6µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.683µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.43µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.653µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.49µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 119.677µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 117.837µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.495µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 98.723µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.883µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.793µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.68µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.084µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.08µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.503µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.936µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.853µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.153µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.397µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.036µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 110.19µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.723µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.513µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.285µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.307µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.814µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.373µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.994µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.033µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 47.171µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.633µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.424µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.977µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.027µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.87µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.23µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 116.803µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.581µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.973µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.41µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 159.693µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 105.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.117µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 49.657µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.31µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.153µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.218µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.522µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.721µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.547µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.63µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 97.333µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.93µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.526µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.696µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.82µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.01µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 109.217µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.36µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.613µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.804µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.427µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 41.93µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.394µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.073µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.573µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.312µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.577µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.715µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.764µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.937µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.536µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.736µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.267µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 127.733µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.07µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.763µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 108.973µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.09µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.51µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.854µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.267µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.717µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.513µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.767µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.053µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.147µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 126.153µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.687µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.036µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.247µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.99µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.927µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.827µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.486µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.223µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.116µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.143µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.893µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.916µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.917µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 88.367µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.583µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.777µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.51µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.656µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.393µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.066µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.38µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.23µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 97.84µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.317µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.85µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.68µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.552µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 96.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.43µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.567µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.96µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.36µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.557µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.59µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.653µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.733µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.05µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.144µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.849µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.51µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.45µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.14µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.44µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.085µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.083µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.516µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.283µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.939µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.93µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 91.823µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.41µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.436µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.65µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.088µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.936µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.783µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.9µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.906µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 95.784µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.343µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.597µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.86µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 113.933µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.086µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.974µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.87µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.68µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.606µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.147µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.897µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.59µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.93µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.244µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 115.509µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.073µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.05µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.155µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.69µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.313µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.305µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 51.596µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.069µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.14µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.135µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.007µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.043µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.287µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.91µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.229µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.959µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.86µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.104µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.8µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.695µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.295µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.976µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 105.007µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.782µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.764µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.23µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.042µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.48µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.146µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.167µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.78µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.129µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.919µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.667µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.64µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 48.311µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.277µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 68.71µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.737µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.287µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.362µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.92µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.286µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.233µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.655µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.368µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 54.074µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.591µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.547µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.254µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.083µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.174µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 61.817µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.656µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.31µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 112.32µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.747µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.766µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.526µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.13µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.142µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.137µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.46µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.283µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.509µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.18µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 112.643µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.483µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 107.567µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.644µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 83.974µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.5µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.74µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 96.397µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 82.613µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.234µs >[negroni] Started GET /clusters >[negroni] Completed 200 OK in 124.852µs >[negroni] Started GET /clusters/56d32397306dc3aa057320922250a070 >[negroni] Completed 200 OK in 230.2µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 58.06µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 63.41µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.543µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.946µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 62.052µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.699µs >[negroni] Started GET /nodes/866bea732a8fead87ff6b1720301a3b6 >[negroni] Completed 200 OK in 1.033355ms >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.107µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.306µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 81.722µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.236µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.613µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.677µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.075µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 79.053µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.167µs >[negroni] Started GET /nodes/e3e6b22f48dd409750f46de51accb317 >[negroni] Completed 200 OK in 720.133µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 60.096µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.243µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 84.769µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.37µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.087µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.15µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.684µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.194µs >[negroni] Started GET /nodes/fa2e86a1d3e5c918018753eb154248a2 >[negroni] Completed 200 OK in 1.034768ms >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.579µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.816µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 103.689µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.743µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.489µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 118.913µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.163µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 56.638µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.76µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 121.833µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.866µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.629µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.003µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 153.506µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 87.079µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 90.153µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 59.25µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.386µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.11µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.484µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.241µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.757µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.859µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 57.767µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.779µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.673µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.68µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.34µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.8µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.249µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.786µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 53.207µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 55.706µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 93.886µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 89.416µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.157µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 86.132µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 67.447µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.983µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.207µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 122.01µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 50.401µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.21µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 75.652µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.433µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 65.934µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.017µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.797µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 78.666µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 72.1µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 66.683µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 69.329µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 100.523µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.093µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 64.66µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 114.969µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 71.707µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 76.927µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 85.719µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 70.587µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 77.386µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 128.642µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 94.929µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 80.696µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 52.991µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 74.827µs >[negroni] Started GET /queue/addd0e0c618ee7d3688e17ba6f078e2e >[negroni] Completed 200 OK in 73.346µs >[negroni] Started DELETE /volumes/3d8325d2095c5196c321cddfd7e3eaea >[heketi] INFO 2018/05/29 06:04:34 Loaded simple allocator >[negroni] Completed 202 Accepted in 115.686293ms >[asynchttp] INFO 2018/05/29 06:04:34 asynchttp.go:125: Started job e68581b0d78ae01a413e88bc3fb35595 >[heketi] INFO 2018/05/29 06:04:34 Started async operation: Delete Volume >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 53.339µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.266µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.28µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.859µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.073µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.986µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 71.987µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.02µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 109.425µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 71.533µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.039µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.259µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 64.017µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.929µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 64.71µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.643µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 43.322µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 83.642µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 64.5µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.819µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 86.852µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 110.999µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.692µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.886µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 49.033µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.57µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.437µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 68.767µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.277µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 118.532µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.757µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.226µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.949µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 68.626µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 56.638µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.342µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 95.333µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 87.662µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.453µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.416µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.133µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.323µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 88.753µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 69.299µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.969µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.586µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.153µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 56.827µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 61.002µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.022µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.976µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.657µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.346µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.709µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 61.913µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.24µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.838µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.194µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 89.826µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.757µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 110.976µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 89.512µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 117.533µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.68µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 48.495µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 88.61µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.014µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.686µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.736µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.969µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.565µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 62.322µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 71.096µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.22µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 69.836µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.413µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 48.612µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 59.923µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 112.593µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.005µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.393µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.973µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.89µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 56.267µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 86.163µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 94.703µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 86.753µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.147µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.766µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.419µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 87.609µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 98.963µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.676µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.753µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.813µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 71.793µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 54.973µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 64.723µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 144.839µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 59.603µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 56.64µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.922µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 126.392µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.04µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 64.549µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.786µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 67.75µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 104.059µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.503µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.976µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.248µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 88.066µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.936µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 81.922µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 50.064µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.433µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.152µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 92.733µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.962µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 112.256µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 93.453µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 58.25µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 60.286µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 59.22µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 50.312µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.575µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 59.036µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 60.358µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 87.299µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.469µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.189µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.623µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.905µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.926µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 102.953µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.093µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.817µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 123.899µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.2µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 45.946µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.06µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.833µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.029µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.698µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 83.229µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.725µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 101.745µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.674µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.77µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.343µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.279µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.364µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 94.996µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 91.853µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 60.044µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.756µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 69.983µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.797µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 112.565µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.509µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.829µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.004µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.979µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.989µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 44.803µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 51.591µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 63.317µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 43.829µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 51.645µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.758µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 48.589µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 60.658µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 50.523µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.702µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 51.723µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 48.991µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.207µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 86.059µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 119.499µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 90.146µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 83.473µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 55.096µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.2µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.433µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 75.79µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 81.18µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.736µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.869µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 124.209µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 81.086µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.522µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.633µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.277µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 78.436µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 63.686µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.997µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 62.432µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.72µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.802µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.14µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 57.048µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 114.683µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.409µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 66.634µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 41.123µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 63.947µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.486µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 74.416µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.956µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.41µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.216µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.337µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 80.583µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.022µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 53.867µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 83.634µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 56.048µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.509µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.663µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.945µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.527µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 93.498µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.469µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 63.931µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 93.389µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 82.435µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 79.959µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 70.395µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.58µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.54µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 111.449µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 69.297µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 84.622µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 77.049µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.75µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 81.26µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 76.602µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 119.549µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 87.683µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 90.405µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 89.123µs >[negroni] Started GET /volumes >[negroni] Completed 200 OK in 533.578µs >[negroni] Started GET /volumes/305a7947a0af7aeebf43a78dd966070b >[negroni] Completed 200 OK in 911.142µs >[negroni] Started GET /volumes/3d8325d2095c5196c321cddfd7e3eaea >[negroni] Completed 200 OK in 889.599µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 73.882µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 122.152µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 71.126µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 69.387µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.745µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.234µs >[negroni] Started GET /queue/e68581b0d78ae01a413e88bc3fb35595 >[negroni] Completed 200 OK in 72.603µs
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1583494
: 1445137 |
1445247