2224233 – client: do not send metrics until the MDS rank is ready

Bug 2224233 - client: do not send metrics until the MDS rank is ready

Summary: client: do not send metrics until the MDS rank is ready

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat Ceph Storage
Classification:	Red Hat Storage
Component:	CephFS
Sub Component:
Version:	5.3
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	medium
Target Milestone:	---
Target Release:	6.1z2
Assignee:	Xiubo Li
QA Contact:	Amarnath
Docs Contact:	Akash Raj
URL:
Whiteboard:
Depends On:
Blocks:	2235257
TreeView+	depends on / blocked

Reported:	2023-07-20 08:39 UTC by Xiubo Li
Modified:	2023-11-03 04:01 UTC (History)
CC List:	5 users (show)
Fixed In Version:	ceph-17.2.6-124.el9cp
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Clones:	2224234 (view as bug list)
Environment:
Last Closed:	2023-10-12 16:34:33 UTC
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Links
System	ID	Priority	Status	Summary	Last Updated
Ceph Project Bug Tracker	61523	None	None	None	2023-07-20 08:40:34 UTC
Red Hat Issue Tracker	RHCEPH-7043	None	None	None	2023-07-20 08:41:38 UTC
Red Hat Product Errata	RHSA-2023:5693	None	None	None	2023-10-12 16:35:31 UTC

Description Xiubo Li 2023-07-20 08:39:49 UTC

In some cases when there are a lot of clients and these clients have a lots of known requests need to replay too, the metrics requests will be dropped by the MDS because the MDS is still in the clientreplay state, and also the useless metric requests will slow down MDS.

Comment 1 RHEL Program Management 2023-07-20 08:39:57 UTC

Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.

Comment 5 Amarnath 2023-09-14 11:59:56 UTC

Hi All,

As per the comment in backported BZ: https://bugzilla.redhat.com/show_bug.cgi?id=2224234#c13 

Followed below verification steps
Verification steps: https://bugzilla.redhat.com/show_bug.cgi?id=2224234#c7


[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph tell mds.0 client ls
2023-09-12T13:41:29.698-0400 7f46bd7fa640  0 client.24917 ms_handle_reset on v2:10.0.209.2:6800/4207929190

2023-09-12T13:41:29.721-0400 7f46bd7fa640  0 client.24923 ms_handle_reset on v2:10.0.209.2:6800/4207929190

[]
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config get client
WHO     MASK  LEVEL  OPTION           VALUE                                                                                                                         RO
global        basic  container_image  registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  * 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph fs status
cephfs - 0 clients
======
RANK  STATE                     MDS                       ACTIVITY     DNS    INOS   DIRS   CAPS  
 0    active  cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm  Reqs:    0 /s  46.2k  46.2k  7204      0   
 1    active  cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg  Reqs:    0 /s  14.2k  14.2k  3222      0   
       POOL           TYPE     USED  AVAIL  
cephfs.cephfs.meta  metadata  1160M  54.0G  
cephfs.cephfs.data    data    3586M  54.0G  
              STANDBY MDS                
cephfs.ceph-fs-6-bz-gebvp1-node5.kbimfq  
MDS version: ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config get client
WHO     MASK  LEVEL  OPTION           VALUE                                                                                                                         RO
global        basic  container_image  registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  * 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config set client client_collect_and_send_global_metrics false
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config get client
WHO     MASK  LEVEL     OPTION                                  VALUE                                                                                                                         RO
client        advanced  client_collect_and_send_global_metrics  false                                                                                                                           
global        basic     container_image                         registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  * 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph orch host ls
HOST                                 ADDR          LABELS                    STATUS  
ceph-fs-6-bz-gebvp1-node1-installer  10.0.210.235  _admin installer mon mgr          
ceph-fs-6-bz-gebvp1-node2            10.0.211.61   osd mon mgr                       
ceph-fs-6-bz-gebvp1-node3            10.0.209.53   osd mon                           
ceph-fs-6-bz-gebvp1-node4            10.0.209.2    mds nfs                           
ceph-fs-6-bz-gebvp1-node5            10.0.208.24   osd mds                           
ceph-fs-6-bz-gebvp1-node6            10.0.210.120  mds nfs                           
6 hosts in cluster
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ssh 10.0.209.2
The authenticity of host '10.0.209.2 (10.0.209.2)' can't be established.
ED25519 key fingerprint is SHA256:DJtttEIYFpibqyY1vMI+th54vWa3etyD486Jllse8bE.
This key is not known by any other names
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.209.2' (ED25519) to the list of known hosts.
root.209.2's password: 
Activate the web console with: systemctl enable --now cockpit.socket

Register this system with Red Hat Insights: insights-client --register
Create an account or view all your systems at https://red.ht/insights-dashboard
[root@ceph-fs-6-bz-gebvp1-node4 ~]# cephadm shell -- ceph daemon cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm config set debug_mds 25
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
Can't get admin socket path: unable to get conf option admin_socket for cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm: b"error parsing 'cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n"
[root@ceph-fs-6-bz-gebvp1-node4 ~]# podman ps
CONTAINER ID  IMAGE                                                                                                                         COMMAND               CREATED       STATUS       PORTS       NAMES
137d76e8f896  registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  -n mds.cephfs.cep...  32 hours ago  Up 32 hours              ceph-fde5e244-5082-11ee-b200-fa163e526700-mds-cephfs-ceph-fs-6-bz-gebvp1-node4-dipxkm
[root@ceph-fs-6-bz-gebvp1-node4 ~]# cephadm shell -- ceph daemon mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm config set debug_mds 25
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
{
    "success": ""
}
[root@ceph-fs-6-bz-gebvp1-node4 ~]# cephadm shell -- ceph daemon mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm config set debug_ms 25
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
{
    "success": ""
}
[root@ceph-fs-6-bz-gebvp1-node4 ~]# cephadm shell -- ceph daemon mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm config set debug_ms 1
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
{
    "success": ""
}
[root@ceph-fs-6-bz-gebvp1-node4 ~]# exit
logout
Connection to 10.0.209.2 closed.
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ssh 10.0.210.120
The authenticity of host '10.0.210.120 (10.0.210.120)' can't be established.
ED25519 key fingerprint is SHA256:BRQi343byaP/pdcvdfFM8MerzDWuaibVcv8LSuzpYb8.
This key is not known by any other names
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.210.120' (ED25519) to the list of known hosts.
root.210.120's password: 
Activate the web console with: systemctl enable --now cockpit.socket

Register this system with Red Hat Insights: insights-client --register
Create an account or view all your systems at https://red.ht/insights-dashboard
[root@ceph-fs-6-bz-gebvp1-node6 ~]# cephadm shell -- ceph daemon mds.cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg config set debug_mds 25
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
{
    "success": ""
}
[root@ceph-fs-6-bz-gebvp1-node6 ~]# cephadm shell -- ceph daemon mds.cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg config set debug_ms 1
Inferring fsid fde5e244-5082-11ee-b200-fa163e526700
Using ceph image with id '724aa5b0b62c' and tag '<none>' created on 2023-09-09 21:19:16 +0000 UTC
registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f
{
    "success": ""
}
[root@ceph-fs-6-bz-gebvp1-node6 ~]# cd /var/lo
local/ lock/  log/   
[root@ceph-fs-6-bz-gebvp1-node6 ~]# cd /var/log/ceph/
[root@ceph-fs-6-bz-gebvp1-node6 ceph]# ls -lrt
total 1024
drwxrwx---. 2  167  167     29 Sep 11 05:13 fde5e244-5082-11ee-b200-fa163e526700
-rw-r--r--. 1 root root 548569 Sep 12 13:48 cephadm.log
[root@ceph-fs-6-bz-gebvp1-node6 ceph]# cd fde5e244-5082-11ee-b200-fa163e526700/
[root@ceph-fs-6-bz-gebvp1-node6 fde5e244-5082-11ee-b200-fa163e526700]# ls -lrt
total 468
-rw-r--r--. 1 root root 476060 Sep 12 13:30 ceph-volume.log
[root@ceph-fs-6-bz-gebvp1-node6 fde5e244-5082-11ee-b200-fa163e526700]# ls -lrt
total 468
-rw-r--r--. 1 root root 476060 Sep 12 13:30 ceph-volume.log
[root@ceph-fs-6-bz-gebvp1-node6 fde5e244-5082-11ee-b200-fa163e526700]# exit
logout
Connection to 10.0.210.120 closed.
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config get mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm
WHO         MASK  LEVEL  OPTION           VALUE                                                                                                                         RO
global            basic  container_image  registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  * 
mds.cephfs        basic  mds_join_fs      cephfs                                                                                                                          
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config set mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm debug_mds 25
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config set mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm debug_ms 1
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config set mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm log_to_file true
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph config get mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm
WHO                                          MASK  LEVEL     OPTION           VALUE                                                                                                                         RO
global                                             basic     container_image  registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f  * 
mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm        advanced  debug_mds        25/25                                                                                                                           
mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm        advanced  debug_ms         1/1                                                                                                                             
mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm        basic     log_to_file      true                                                                                                                            
mds.cephfs                                         basic     mds_join_fs      cephfs                                                                                                                          
[root@ceph-fs-6-bz-gebvp1-node7 ~]# client_loop: send disconnect: Broken pipe
amk:cephci$ ssh cephuser.210.25
cephuser.210.25's password: 
Register this system with Red Hat Insights: insights-client --register
Create an account or view all your systems at https://red.ht/insights-dashboard
Last login: Tue Sep 12 13:40:44 2023 from 10.67.24.67
[cephuser@ceph-fs-6-bz-gebvp1-node7 ~]$ sudo -i
[root@ceph-fs-6-bz-gebvp1-node7 ~]# mkdir /mnt/fmount/
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph-fuse -n client.admin /mnt/fmount/
2023-09-13T00:37:05.079-0400 7f2e65110300 -1 init, newargv = 0x55c30830cdc0 newargc=15

ceph-fuse[13800]: starting ceph client
ceph-fuse[13800]: starting fuse
[root@ceph-fs-6-bz-gebvp1-node7 ~]# mount | grep ceph
ceph-fuse on /mnt/fmount type fuse.ceph-fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ssh 10.0.209.2
root.209.2's password: 
Activate the web console with: systemctl enable --now cockpit.socket

Register this system with Red Hat Insights: insights-client --register
Create an account or view all your systems at https://red.ht/insights-dashboard
Last login: Tue Sep 12 13:45:20 2023 from 10.0.210.25
[root@ceph-fs-6-bz-gebvp1-node4 ~]# grep "client_metric_type"  /var/log/ceph/
cephadm.log                           cephadm.log-20230913.gz               fde5e244-5082-11ee-b200-fa163e526700/ 
[root@ceph-fs-6-bz-gebvp1-node4 ~]# grep "client_metric_type"  /var/log/ceph/fde5e244-5082-11ee-b200-fa163e526700/ceph-mds.cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm.log 
2023-09-13T04:37:06.083+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 4 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:07.083+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 5 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:08.083+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 6 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:09.083+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 7 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:10.083+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 8 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:11.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 9 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:12.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 10 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:13.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 11 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:14.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 12 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:15.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 13 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:16.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 14 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:17.084+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 15 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:18.085+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 16 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:19.085+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 17 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:20.085+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 18 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:21.085+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 19 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:22.085+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 20 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:23.086+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 21 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:24.086+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 22 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:25.086+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 23 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:26.086+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 25 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:27.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 26 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:28.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 27 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:29.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 28 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:30.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 29 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:31.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 30 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:32.087+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 31 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:33.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 32 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:34.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 33 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:35.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 34 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:36.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 35 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:37.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 36 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:38.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 37 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:39.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 38 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:40.088+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 39 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:41.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 40 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:42.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 41 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:43.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 42 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:44.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 43 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:45.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 44 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:46.090+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 46 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:47.089+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 47 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
2023-09-13T04:37:48.090+0000 7f418c4cf640  1 -- [v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190] <== client.24998 10.0.210.25:0/2464744716 48 ==== client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.000909, avg_latency: 0.000909, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 1 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 ==== 328+0+0 (crc 0 0 0) 0x55edd9138420 con 0x55edda3ce400
[root@ceph-fs-6-bz-gebvp1-node4 ~]# 
[root@ceph-fs-6-bz-gebvp1-node4 ~]# 
[root@ceph-fs-6-bz-gebvp1-node4 ~]# exit
logout
Connection to 10.0.209.2 closed.
[root@ceph-fs-6-bz-gebvp1-node7 ~]# 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# mount | grep ceph
ceph-fuse on /mnt/fmount type fuse.ceph-fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph fs status
cephfs - 1 clients
======
RANK  STATE                     MDS                       ACTIVITY     DNS    INOS   DIRS   CAPS  
 0    active  cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm  Reqs:    0 /s  46.2k  46.2k  7204      0   
 1    active  cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg  Reqs:    0 /s  14.2k  14.2k  3222      1   
       POOL           TYPE     USED  AVAIL  
cephfs.cephfs.meta  metadata  1160M  54.0G  
cephfs.cephfs.data    data    3586M  54.0G  
              STANDBY MDS                
cephfs.ceph-fs-6-bz-gebvp1-node5.kbimfq  
MDS version: ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph versions
{
    "mon": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 3
    },
    "mgr": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 2
    },
    "osd": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 12
    },
    "mds": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 3
    },
    "overall": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 20
    }
}
[root@ceph-fs-6-bz-gebvp1-node7 ~]# 

[root@ceph-fs-6-bz-gebvp1-node7 ~]# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.0.210.25  netmask 255.255.252.0  broadcast 10.0.211.255
        inet6 fe80::f816:3eff:fec8:afbd  prefixlen 64  scopeid 0x20<link>
        inet6 2620:52:0:d0:f816:3eff:fec8:afbd  prefixlen 64  scopeid 0x0<global>
        ether fa:16:3e:c8:af:bd  txqueuelen 1000  (Ethernet)
        RX packets 2073929  bytes 1983532070 (1.8 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1292986  bytes 3173697475 (2.9 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 59  bytes 7712 (7.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 59  bytes 7712 (7.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@ceph-fs-6-bz-gebvp1-node7 ~]#

Comment 6 errata-xmlrpc 2023-10-12 16:34:33 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage 6.1 security, enhancement, and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:5693

Note You need to log in before you can comment on or make changes to this bug.